Senior Data Engineer

Who are we?

Lumicode Sp. z o.o. is part of the Pentacomp Group, which has been delivering IT solutions and technology services to major enterprises and public sector institutions for nearly 30 years.

We deliver projects that support our clients’ digital transformation, combining expertise with modern technologies.

Technical requirements

• Strong experience with Python, SQL, and Apache Spark

• Hands-on experience with Azure Data Platform, including Azure Databricks, Data Factory, Data Lake, and Synapse Analytics

• Experience in designing and maintaining ETL/ELT pipelines

• Knowledge of Delta Live Tables (DLT), Unity Catalog, and Lakehouse architecture

• Experience with Databricks workflows, CI/CD, and Azure DevOps

• Understanding of infrastructure automation, monitoring, logging, and data governance

• Familiarity with Power BI and Azure Data Explorer

Responsibilities

• Design, develop, and optimize scalable data solutions within the Azure ecosystem

• Build and maintain ETL/ELT pipelines using Python, SQL, and Spark

• Develop Databricks workflows, DLT pipelines, and metadata-driven solutions

• Support data platform migrations, modernization, and Unity Catalog implementation

• Ensure data quality, security, performance, and reliability

• Contribute to CI/CD, infrastructure automation, monitoring, and troubleshooting

• Collaborate with Data Architects, analysts, and business stakeholders to deliver effective data solutions

• Optimize data processing and storage costs while following Lakehouse and governance principles

Other important information

• Strong analytical and problem-solving skills

• Ability to work independently, take ownership, and proactively drive initiatives

• Excellent communication and collaboration skills

• Adaptability to changing priorities and incomplete requirements

• Experience working in cross-functional teams and dynamic environments

• Practical, solution-oriented mindset and ability to thrive in a fast-paced environment with limited formal processes