Data Operations Engineer – Hadoop / Linux / SQL

Industry: Banking

Location: hybrid - 3 days per week form Warsaw, Gdańsk or Gdynia

Rate: 105 pln/h on b2b

Overview

This position is for an operations consultant responsible for ingesting data onto Hadoop using the ARC Ingestion Framework. The ideal candidate will possess experience in an agile environment and proficiency in Linux, SQL, and git. The role requires expertise in preparing and testing configurations for data ingestion as well as maintaining existing data sources in production.

Main Responsibilities

• Ingest data onto Hadoop using the ARC Ingestion Framework.

• Prepare and test configurations for data ingestion sources.

• Maintain and monitor sources already ingested into production.

• Collaborate with cross-functional teams.

• Ensure high-quality standards in data processing.

• Utilize troubleshooting skills to resolve issues.

• Document processes and configurations.

Key Requirements

• Proficiency in Unix / Linux.

• Strong SQL skills.

• Experience with git.

• Familiarity with Jenkins.

• Demonstrated rational thinking and problem-solving abilities.

• Strong troubleshooting skills.

Nice to Have

• Experience with testing frameworks.

• Familiarity with Hadoop.

• Knowledge of Robot Framework.

• Experience with JIRA, Confluence, and Helix.

• Basic understanding of Python.