
Westcode · Kraków
Senior Data Engineer
W skrócie
zdania wybrane z oferty- designing and developing scalable data pipelines
- processing and transforming large volumes of structured and unstructured data
- West Code is looking for experienced Data Engineers interested in building modern data platforms and working on projects involving large-scale data processing, real-time analytics and event-driven systems.
Technologie
Pełny opis
z justjoin.itSenior Data Engineer
Real-Time Data & Streaming | Data Platforms, Analytics & Event Processing
The Mission
West Code is looking for experienced Data Engineers interested in building modern data platforms and working on projects involving large-scale data processing, real-time analytics and event-driven systems.
We are particularly interested in engineers who enjoy solving complex data challenges, designing reliable pipelines and working with technologies that support real business decisions.
Depending on the project, you may work on streaming data platforms, sports analytics, financial data processing, predictive analytics or modern cloud-based data solutions.
What You’ll Work On
designing and developing scalable data pipelines
processing and transforming large volumes of structured and unstructured data
building and improving modern data platforms
integrating data from APIs, databases and external sources
batch and real-time data processing
improving data quality, reliability and performance
developing data solutions supporting analytics and machine learning
collaborating with Data Scientists, Backend Engineers and business teams
contributing to architecture and technology decisions
Technology
We are particularly interested in engineers working with:
Python and SQL
Apache Spark / PySpark
Apache Kafka or other streaming technologies
AWS, Azure or GCP
Databricks or similar data platforms
Airflow or other orchestration tools
Docker, Kubernetes and CI/CD
You don't need to know every technology listed above. What matters most is strong engineering experience and the ability to work with complex data systems.
Must Have
3+ years of professional experience in Data Engineering, including hands-on ownership of production data lakes or lakehouse platforms
experience with cloud object storage (S3/GCS) and platforms such as Snowflake, Databricks or BigQuery
practical experience with open table formats (Apache Iceberg, Delta Lake or Hudi)
strong SQL skills and solid understanding of relational databases, data modelling and transactional data
experience with CDC and streaming data ingestion (Kafka, Debezium or equivalent technologies)
experience optimizing large-scale datasets through partitioning, file layout and query performance tuning
understanding of data quality, consistency, reconciliation and monitoring in production environments
practical knowledge of data governance, including access control, data lineage, PII protection and retention
working knowledge of Python and orchestration tools such as Airflow or Dagster
good English and ability to independently own technical solutions and collaborate with engineering teams
Strong Advantage
experience with financial transactions, payment systems, wallets or ledger data
background in fintech, iGaming, betting or other regulated industries
experience designing bronze/silver/gold lakehouse architectures
experience with Trino, Athena or large-scale analytical query engines
hands-on experience with late-arriving events, deduplication and schema evolution
experience with regulatory data retention, GDPR requirements and auditability
cloud infrastructure cost optimization and storage lifecycle management
Working Model
B2B cooperation
remote or hybrid work depending on the project
international engineering teams
projects involving modern data platforms and complex data processing
English used on most projects
B2B Rate
150–200 PLN/h + VAT
Final rate depends on seniority, technical expertise and project scope.
Why West Code
West Code builds engineering teams around strong technical delivery, ownership and practical problem-solving.
We work on technology projects where engineering quality, modern tools and understanding the business context matter.
Our approach combines experienced engineers, AI-enabled delivery practices and accountability for the quality of what we build.
We value engineers who are curious, take ownership and enjoy working on challenging technical problems.
If you have strong Data Engineering experience and want to work on interesting, data-intensive systems, apply and let's talk.
Treść ogłoszenia pochodzi z justjoin.it i należy do jego autora.
Historia oferty
2 zmian treści- Zmiana tytułu
Senior Real-Time Data Engineer→ Senior Data Engineer - Zmiana wymagań
+ Data Lakehouse+ AWS+ Snowflake+ Apache Iceberg+ Apache Kafka+ Airflow− Kafka− Flink− Event Streaming
- Podbita na górę listy
Pracodawca odświeżył ogłoszenie na portalu.
- Opublikowana na justjoin.it