Senior Data EngineerLocation:WiltshireContract:2 months Pay:Up to 62.50p/h Inside IR35 (DOE)Due to the nature of the work, we require candidates who already hold active MOD DV clearance. Responsibilities:Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis.Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL.Design data models, schemas and data contracts / Interface Control Documents (ICDs) to support reliable integration between systems.Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage.Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose.Develop tools for data-driven insights and task automation, and research and adopt appropriate emerging technologies.Collaborate with customer and internal stakeholders to define data, interface and tool requirements.Work closely with DevOps Engineers, Data Scientists, Analysts and Cyber Consultants to deliver integrated solutions.Take ownership of deliverables and ensure the quality, security, and maintainability of outputs. Experience requiredProven experience delivering data engineering solutions in a project or production environment.Strong Python and SQL skills.Hands-on experience with Apache NiFi and data pipeline orchestration.Experience with data ..... full job details .....