Lead Data Platform Engineer
Lead Data Platform Engineer £75,000 - £85,000 Remote You are a well-experienced Lead Data Platform Engineer, looking to take ownership of a modern lakehouse platform and shape best-in-class data engineering practices. THE COMPANY This industry-leading organisation serves specialist, people-first knowledge to its clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically, you can expect to be involved in the following: Designing and developing end-to-end data platform solutions in Azure using DatabricksBuilding and maintaining automation for cluster management, monitoring, tagging, and platform optimisation.Implementing CI/CD and DevOps best practices across data pipelines and platform components.Taking ownership of design decisions and long-term architectural direction. SKILLS AND EXPERIENCE The successful Lead Data Engineer will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering.Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory.Solid understanding of DevOps practices including CI/CD and automated testing.Experience with monitoring, logging, and alerting solutions.Ability to work effectively with stakeholders across engineering functions. BENE
Other jobs of interest...
Perform a fresh search...
-
Create your ideal job search criteria by
completing our quick and simple form and
receive daily job alerts tailored to you!