
W skrócie
zdania wybrane z oferty- Reverse-engineer and analyze existing behavioural data pipelines (DF2 and BAG), mapping data flows, transformation logic, schemas, and dependencies.
- 5+ years of data engineering experience focused on ETL/ELT pipelines, data mapping, and reverse engineering.
- Advanced SQL and Python (or Scala) skills for data profiling and transformation analysis.
Technologie
Pełny opis
z justjoin.itSNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.
Responsibilities:
Reverse-engineer and analyze existing behavioural data pipelines (DF2 and BAG), mapping data flows, transformation logic, schemas, and dependencies.
Evaluate new data sources for schema compatibility, quality risks, mapping gaps, and performance benchmarks.
Document schema equivalencies, technical comparisons, and data quality mitigation strategies.
Partner with design teams to produce architectural specs for a unified, scalable future-state pipeline.
Ensure data accuracy, output consistency, and system performance during migration planning.
Skills:
5+ years of data engineering experience focused on ETL/ELT pipelines, data mapping, and reverse engineering.
Advanced SQL and Python (or Scala) skills for data profiling and transformation analysis.
Cloud & Big Data platforms: AWS (S3, Redshift) and Apache Spark for large-scale data processing.
Behavioral data architectures, event-driven ingestion, and complex schema mapping.
Technical documentation and ability to deliver independently under tight deadlines.
Follow us on Linkedin! http://linkedin.com/company/snisourcing
Treść ogłoszenia pochodzi z justjoin.it i należy do jego autora.
Historia oferty
bez zmian od publikacji- Podbita na górę listy
Pracodawca odświeżył ogłoszenie na portalu.
- Opublikowana na justjoin.it