Role Overview: Creditsafe is looking for a Data Engineer to join our Data Cloud team. In this role, you will work on building and scaling a data platform that supports our clients by delivering valuable insights. We focus on collaboration, innovation, and professional growth, and offer flexible working arrangements to promote work-life balance.
About Us: Creditsafe provides data on over 320 million companies across 100 countries. We help our clients uncover insights by collecting and processing large amounts of complex data. We are in an exciting growth phase, expanding our data capabilities to deliver even more value to our customers. Our team is diverse, collaborative, and committed to helping each member grow.
Your Role: You will join a technically skilled team redesigning our data platform with a focus on scalability and high throughput. We use AWS technologies such as Redshift and S3 to manage and process billions of data objects. As part of this role, you will work with Python to transform raw data into useful formats and ensure that our APIs are fast and reliable.
Key Responsibilities:
- Actively contribute to the codebase and participate in peer reviews.
- Design and build a metadata-driven, event-based distributed data processing platform using Python, Airflow, Redshift, DynamoDB, AWS Glue, and S3.
- Play a key role in the design, development, and deployment of our core systems.
- Build and scale data pipelines, particularly moving data between Redshift and S3.
- Implement practices like continuous integration and deployment to enable rapid delivery.
- Understand company and domain data to make recommendations for product improvements.
Skills and Qualifications:
-
Data Engineering Best Practices: Strong understanding of and ability to implement best practices.
-
Code Quality: Ability to write clean, efficient code and optimize for performance in a cloud environment.
-
Experience: Proven experience developing production-grade data pipelines using Python in a commercial environment.
-
Problem-Solving: Enthusiastic about tackling technical challenges and collaborating with team members to find solutions.
-
Communication: Strong communication skills, able to share ideas clearly and work well in a collaborative team.
-
Leadership: Ability to mentor engineers, complete hands-on technical work, and provide guidance on complex issues.
-
Collaboration: Open to sharing ideas and contributing to wikis, discussion boards, and team decisions.
Why Join Creditsafe?
-
Career Progression: Clear career paths with opportunities to grow as a technical leader or transition into other roles.
-
Learning & Development: Access to a wide range of learning resources, with dedicated time each week for training and skill development.
-
Work-Life Balance: Flexible working hours and hybrid options to support a balanced lifestyle.
-
Innovation: Work on exciting projects using cutting-edge cloud computing and data management technologies.
Our Technology Stack: We use Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, Lambda, API Gateway, Terraform, and CI/CD.
Benefits:
- Competitive Salary.
- Company Laptop.
- 25 Days Annual Leave (plus bank holidays).
- Hybrid working model.
- Healthcare & Company Pension.
- Cycle to Work and Wellbeing Programme.
- Global company gatherings and events.
- E-learning and career progression opportunities.
We are committed to diversity and inclusion. If you need any support during the application process, please let us know.