Job Advertisement: Software Developer / Senior Data Engineer

Location: London
Contract Length: 12 Months
Daily Rate: -700 (Umbrella)

Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer / Senior Data Engineer to join their dynamic team!

About the Role:

You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics, and business consumption. This is your opportunity to contribute significantly as the project progresses towards crucial go-live milestones between March and June 2027!

Key Responsibilities:

• Design & Build: Create and maintain scalable data pipelines using Python and SQL.
• Optimise Solutions: Develop, optimise, and support enterprise data platform solutions.
• Data Integration: Build and manage data ingestion, transformation, and integration processes.
• Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments.
• Business Logic Development: Implement business logic, calculations, and data processing solutions using Python.
• Collaboration: Work closely with business stakeholders and engineering teams to deliver high-quality data assets.
• Quality Assurance: Ensure data quality, performance, scalability, and governance standards are met.
• Documentation: Produce technical documentation, architecture artefacts, and data flow specifications.
• Performance Improvement: Identify and resolve performance bottlenecks across pipelines and processing workflows.

Required Skills & Experience:

Essential:

• Strong commercial experience in Python development.
• Proficient in SQL, including query optimisation and data modelling.
• Hands-on experience with Databricks.
• Proven track record in designing and building enterprise data platforms.
• Experience in developing ETL/ELT pipelines and data integration solutions.
• Strong understanding of data lakes and lakehouse architectures.
• Experience working with large-scale datasets and modern data engineering practises.
• Ability to design and deliver end-to-end data solutions.
• Strong analytical and problem-solving skills.
• Excellent stakeholder management and communication skills.

Highly Desirable:

• Experience with Spark / PySpark.
• Familiarity with Azure Data Lake, Snowflake, or similar platforms.
• Knowledge of orchestration tools like Airflow or Azure Data Factory.
• Exposure to financial services environments.
• Experience supporting large-scale data transformation or migration programmes.

What We''re Looking For:

• A senior-level contractor who can hit the ground running.
• Someone comfortable working autonomously with minimal oversight.
• Proven experience in delivering long-term contract engagements (12 months or longer).
• Strong interpersonal skills with a team-oriented approach.
• Immediate availability or able to start quickly.

Key Deliverables:

• Delivery of scalable, reliable, and performant data pipelines.
• Development of robust data models and platform structures.
• Successful implementation of data engineering solutions that support the enterprise data platform.
• High-quality data assets for reporting, analytics, and business consumption.
• Contribution to platform go-live milestones between March and June 2027.

Join our client and be part of something big! If you are ready to take on a challenging and rewarding role, we want to hear from you! Apply now and help shape the future of data!