Senior Data Engineer | Krakow

Job Description: Senior Data Engineer – Databricks, PySpark & Python

Location: Kraków, Poland
Work Model: Hybrid – 3 days per week in the office
Experience: 7+ years
Domain: Banking, Financial Services & Insurance (BFSI)

About the Role

We are looking for an experienced Senior Data Engineer with strong expertise in Python development, Databricks, PySpark, and modern data engineering practices. The ideal candidate will have hands-on experience developing FastAPI-based services, building scalable data pipelines, implementing real-time streaming solutions, and leading Unity Catalog migration initiatives.

This role requires a technically strong, hands-on professional who can independently design, develop, optimize, and maintain enterprise-grade data solutions while collaborating with business stakeholders and cross-functional engineering teams in the BFSI domain.

Key Responsibilities

• Data Engineering & Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, SQL, and Delta Lake.

• Python & API Development: Develop, enhance, and maintain FastAPI-based services, REST APIs, and integrations to support enterprise data platforms.

• Databricks & Lakehouse Engineering: Implement robust data processing solutions using Databricks, Delta Lake, and modern lakehouse architecture principles.

• Unity Catalog Migration: Lead and execute Unity Catalog migration initiatives, including data governance, access controls, metadata management, and migration validation.

• Real-Time Data Processing: Develop and optimize Databricks Structured Streaming solutions for real-time and near-real-time data ingestion and processing.

• Database & Legacy Integration: Integrate and modernize data workflows involving Oracle, Microsoft SQL Server, and Informatica.

• Performance Optimization: Identify and resolve performance bottlenecks across Spark jobs, SQL queries, streaming workloads, and data pipelines.

• Cloud & DevOps: Support automated deployments, CI/CD pipelines, version control, and release management using Azure DevOps, GitLab, and Git.

• Solution Design: Independently translate business and technical requirements into scalable, secure, reliable, and maintainable data engineering solutions.

• Collaboration & Technical Leadership: Work closely with architects, business analysts, data engineers, and stakeholders to deliver high-quality solutions aligned with enterprise standards.

• BFSI Compliance: Follow applicable data governance, security, auditability, and regulatory requirements relevant to banking and financial services.

Mandatory Skills & Experience

• 7+ years of professional experience in data engineering and software development, with strong hands-on Python expertise.

• Strong proficiency in Databricks, PySpark, SQL, and Delta Lake.

• Hands-on experience developing, enhancing, and integrating APIs using FastAPI.

• Proven experience with Databricks Unity Catalog migrations.

• Strong experience with Databricks Structured Streaming and real-time data processing.

• Practical experience integrating with Oracle, Microsoft SQL Server, and Informatica.

• Ability to independently design and implement scalable, high-performance data pipelines and data processing solutions.

• Good understanding of data modeling, data integration, ETL/ELT patterns, and data quality practices.

• Experience working in or supporting the Banking, Financial Services, and Insurance (BFSI) domain.

• Strong analytical, troubleshooting, communication, and problem-solving skills.

What We Are Looking For

The ideal candidate is a hands-on Senior Data Engineer who combines strong engineering fundamentals with practical experience across the Databricks ecosystem. They should be comfortable taking ownership of complex technical initiatives, driving data platform modernization, improving pipeline performance, and delivering reliable data solutions in a regulated enterprise environment.