Our key client is looking for an Azure Databricks Developer with SC and NPPv3 on a 6 months+ contract. The Azure Databricks Developer is responsible for designing, developing, testing and supporting scalable data engineering solutions using Azure Databricks and the wider Azure data platform. The role focuses on building robust data ingestion, transformation and processing pipelines that enable advanced analytics, AI, machine learning and business intelligence solutions. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, the Azure Databricks Developer helps deliver trusted, high-quality data products while ensuring adherence to security, governance and operational standards. Requirement: NPPV3/SC clearance Key Responsibilities Data Engineering and DevelopmentDesign and develop data pipelines using Azure Databricks. Build scalable ETL/ELT solutions using PySpark, Spark SQL and Delta Lake. Develop ingestion frameworks for batch and streaming data. Develop outbound pipelines that interface with APIs Optimise large-scale data processing workloads for performance and cost efficiency. Data IntegrationIntegrate data from:Azure SQL DatabaseAzure Data Lake Storage Gen2 Microsoft Fabric APIs and third-party SaaS platforms On-premise systems Event streaming platforms Implement automated data validation and reconciliation processes. Data ModellingImplement bronze, silver and gold data architectures. Optimise storage structures using Delta Lake ..... full job details .....