Contract
Databricks Data Engineer
London
225491767
Posted Yesterday
Databricks Data Engineer - Data Ingestion
6 months - -550 a day (outside IR35)
Location: UK - Hybrid/Remote
We are looking for an experienced Databricks Data Engineer / Data Ingestion Engineer to join a large, global organisation.
The role is focused on data ingestion and engineering, connecting data from multiple sources and building robust pipelines within a modern Azure/Databricks environment.
Key Responsibilities
- Build and maintain data ingestion pipelines using Databricks.
- Connect to multiple data sources including SQL databases, APIs and Azure services.
- Develop pipelines using Azure Data Factory and Databricks Lakeflow.
- Implement appropriate ingestion strategies including incremental and batch loads.
- Develop ETL/ELT processes using Databricks Medallion Architecture.
- Write and maintain Python data engineering code.
- Use dbt for data transformation and modelling.
- Ensure pipelines are scalable, reliable and maintainable.
Key Skills
- Strong commercial Databricks experience.
- Proven data ingestion experience.
- Azure Data Factory.
- Databricks Lakeflow.
- SQL and API integration.
- Medallion Architecture.
- Strong Python.
- dbt.
- Experience with incremental/batch data ingestion.
We''re looking for this person to be Immediate availability or able to start within 1-2 weeks.
Other jobs of interest...
Castleton Commodities International
City of LondonYesterday
Castleton Commodities International
CityYesterday
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!