Senior Data Platform Engineer - Compliance Assurance
Job Title: Senior Data Platform Engineer - Compliance AssuranceContract: 12 MonthsLocation: Chester -3 days per week onsiteRate: Highly CompetitiveStatus: Inside IR35Working pattern: Fulltime About the roleWe are looking for a hands-on Senior Data Platform Engineer to design, build and maintain scalable data platforms that support Compliance Assurance within a regulated enterprise environment.You will take ownership of the end-to-end data engineering lifecycle, from integrating source systems and ingesting data through to streaming, processing, storage and automated compliance controls. You will develop reliable, production-grade solutions that identify missing records, data mismatches, configuration issues and other exceptions, ensuring data quality, traceability and auditability.This is a developer-led engineering role, ideal for someone who combines strong data engineering skills with software development expertise and a focus on production reliability. Essential skills and experienceStrong hands-on experience developing data engineering solutions using Python and PySpark.Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration.Experience working with Hadoop, Hive or comparable enterprise data-lake technologies.Solid knowledge of SQL, data transformation, data modelling and large-scale data processing.Experience integrating REST APIs, including authentication, pagination, rate limiting and error handling.Understanding of data ..... full job details .....
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!