Data Engineer | Wroclaw

💡 We are looking for a Data Engineer with strong hands-on experience in Azure Data Factory (ADF) to join a long-term project with a major international Swiss investment bank. Experience with Azure Databricks (ADB) will be considered a significant advantage.

📍 Location: Wroclaw&Krakow, hybrid 3-4 days/week

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Python.

• Build and optimize ETL/ELT workflows for processing large volumes of data.

• Write efficient, reusable, and high-performance code with a strong focus on optimization.

• Process and manage structured and unstructured data from multiple sources.

• Implement best practices related to data engineering, performance tuning, and code quality.

• Develop, orchestrate, and monitor data workflows using Azure Data Factory (ADF).

• Collaborate with Data Scientists, Data Analysts, Solution Architects, and other stakeholders.

• Ensure data quality, reliability, and integrity across all data platforms.

• Troubleshoot and resolve performance bottlenecks in data processing pipelines.

• Contribute to data architecture discussions and continuous improvement initiatives.

Required Skills & Experience

• 6–10 years of overall IT experience.

• 4–5 years of hands-on experience in PySpark and Python development.

• Strong understanding of data engineering principles and modern data pipeline architectures.

• Proven expertise in:

  • PySpark (Spark SQL, DataFrames, performance tuning)

  • Python scripting and application development

  • Azure Data Factory (ADF) orchestration and pipeline development

• Strong knowledge of data optimization techniques, including partitioning, caching, joins, and query optimization.

• Experience working with large-scale distributed data processing systems.

• Strong analytical and problem-solving skills.

• Good understanding of SQL, database concepts, and data modeling.

Nice-to-Have Skills

• Hands-on experience with Azure Databricks (ADB).

• Exposure to cloud technologies, preferably Microsoft Azure.

• Experience with CI/CD pipelines and DevOps practices for data engineering.

• Knowledge of Data Lake and Lakehouse architectures.

• Familiarity with modern data governance and monitoring practices.

Benefits ✅

• Stable long-term cooperation with opportunity for extension

• Opportunity to work with modern technologies in an international environment

• Professional growth and continuous development opportunities

• Participation in challenging and impactful projects

📩 If you’re interested and meet the qualifications, please send your CV at [email protected]