img
Contract

Data Quality Engineer (Databricks)

London
money-bag 10000-500000 Daily
3134544214
Posted Today

Data Quality Engineer is required by a global IT company to join their growing data engineering team. You will be responsible for: Defining, implementing and managing data quality rules across data ingestion, transformation and reporting layers within a Databricks-based lakehouse. Developing automated regression and contract tests for data pipelines and business-critical reports. Building automated data quality assertions and deployment quality gates for CI/CD pipelines. Reproducing reported data issues and converting them into automated regression tests. Reviewing transformation logic and data quality changes, ensuring appropriate test coverage. Working closely with data engineers and business stakeholders to identify, prioritise and resolve data quality issues. Maintaining testing documentation and contributing to continuous improvement of data quality practices. Required experience and skills: Extensive experience testing data pipelines and ETL/ELT processes. Databricks. Strong SQL skills with experience of complex data transformations. Experience designing and implementing automated data quality and regression testing. Knowledge of schema validation, data reconciliation and contract testing. Experience of integrating automated testing into CI/CD pipelines. Agile environment experience. ..... full job details .....

Other jobs of interest...

Source 4
Ash ValeToday
money-bag£36000 - £39000/annum
Hudson Shribman
SurreyToday
money-bag£35,000
ReeVR
LondonToday
money-bag35000.00-35000.00 Annual
Mactech Energy Group
CityToday
money-bag10000-500000 Annual
Hudson Shribman
SurreyToday
money-bag35000.00-35000.00 Annual
Airbus Belfast Limited
CityToday
money-bag10000-500000 Annual
Airbus Belfast Limited
CityToday
money-bag10000-500000 Annual
ReeVR
SloughToday
money-bag50000.00-50000.00 Annual
Careerwise
LondonToday
money-bag10000-500000 Daily
Airbus Belfast Limited
CityToday
money-bag10000-500000 Annual

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!