Senior Data Engineer

Responsibilities

• Design, develop and maintain data ingestion, integration and processing solutions.

• Build and maintain data products, data warehouse solutions and ETL/ELT processes.

• Develop scalable data solutions using Azure, Databricks, Apache Spark, Azure Data Factory and Delta Lake.

• Make technical and architectural decisions in collaboration with Product Owners and Architects.

• Ensure data quality, security, performance and solution stability.

• Collaborate with stakeholders, Data Stewards, architects and IT teams.

• Develop automated testing, CI/CD pipelines and deployment processes.

• Promote best practices and modern approaches to data engineering.

Requirements

• Several years of experience in Data Engineering and designing data products or data warehouse solutions.

• Strong expertise in Python and SQL.

• Expert knowledge of Apache Spark, Databricks and modern data processing architectures.

• Strong experience with Azure data services, including Azure Data Factory and Delta Lake.

• Good understanding of data modelling, ETL/ELT processes and data architecture.

• Strong understanding of Azure technology choices, costs and trade-offs.

• Experience with API development and integration is a plus.

• Knowledge of Master Data Management (MDM) is a plus.

• Strong communication and collaboration skills with both technical and business stakeholders.