We are looking for an experienced Technology Architect with strong expertise in PySpark, Azure Data Factory (ADF), and Databricks to join our team. The ideal candidate will have 10+ years of experience in Data Engineering and excellent client-facing skills.

Responsibilities

Gather and understand client requirements, create conceptual diagrams, and develop data models.

Work hands-on with Medallion architecture using Azure services.

Utilize Erwin for data modeling and implement performance optimization in data transformation.

Guide the engineering team on development activities using ADF, Databricks, Python, JSON, and YAML.

Build and maintain source-to-target mapping documentation.

Apply strong knowledge of dimensional modeling, normalization, data harmonization, and schema design.

Deploy code artifacts using GitHub Actions and CI/CD pipelines.

Collaborate effectively with cross-functional teams.

(Plus) Experience with Log Analytics and KQL queries.

Manage configuration settings using JSON files.

Requirements

10–15 years of relevant Data Engineering experience.

Strong technical project management, communication, and problem-solving skills.

Proven hands-on experience with PySpark, ADF, and Databricks.

Seniorität level

Mid-Senior level

Employment type

Contract

Job function

Information Technology

Industries

IT Services and IT Consulting

#J-18808-Ljbffr