Data Engineer

We are seeking a Data Engineer to join a newly launched business reporting initiative for a global food and beverage leader with a portfolio of widely recognized consumer brands. In this role, you will work between business stakeholders and a diverse landscape of existing reporting tools, connecting multiple data sources, building ingestion and transformation pipelines on Azure, and consolidating advertising and marketing spend KPIs into a single source of truth.

Essential functions

• Source Integration: Establish connections with each of the existing reporting tools and data sources, choosing the right ingestion approach based on each source’s capabilities.

• Pipeline Development: Design and build data pipelines in Azure Data Factory to bring advertising and marketing expense data onto the platform reliably.

• Data Transformation: Process, clean and model data in Databricks using PySpark and SQL to produce consistent, comparable KPIs across sources.

• Master Table Ownership: Consolidate key KPIs into a central “Master” table that serves as the single source of truth for marketing and advertising expense reporting.

• Requirements Shaping: Work closely with business stakeholders to clarify, refine and adapt to evolving requirements as the project takes shape.

Qualifications

• Commercial experience as a Data Engineer on the Azure platform.

• Databricks Expertise: Hands-on experience building data processing logic with PySpark and SQL.

• Azure Data Factory: Practical experience designing and orchestrating data pipelines in ADF.

• Azure Platform Knowledge: General understanding of the Azure platform structure, its major services and how they relate to each other.

• Strong Soft Skills: Confident communication with business stakeholders and comfort working in a new project where requirements are not yet fixed.

• Proactive Mindset: Ability to ask the right questions, propose solutions and bring structure to ambiguous tasks.

Would be a plus

• Azure DevOps: Experience building CI/CD pipelines for Azure Data Factory.

• Databricks Deployment Automation: Experience setting up DevOps pipelines for Databricks workloads.

We offer

• Opportunity to work on bleeding-edge projects

• Work with a highly motivated and dedicated team

• Competitive salary

• Flexible schedule

• Benefits package - medical insurance, sports

• Corporate social events

• Professional development opportunities

• Well-equipped office

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.