IngestOps Engineer

IngestOps Engineer

We are currently looking for an IngestOps Engineer to join the team of our global client from the banking industry. You will be responsible for ingesting data onto Hadoop using the ARC Ingestion Framework: preparing and testing configurations for new data sources and maintaining sources already running in production. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us.

• Rate: up to 120 PLN/h net (B2B)

• Work Model: hybrid, 1 day per week from the office, full-time (40 h/week)

• Location: Warsaw, Łódź or Tricity (Gdańsk/Gdynia)

Responsibilities:

• Ingesting data onto Hadoop using the ARC Ingestion Framework

• Preparing and testing configurations for new ingestion sources

• Maintaining and supporting sources already ingested in production

• Troubleshooting ingestion issues across different applications and configurations

• Working in an Agile team with data, application and infrastructure stakeholders

Requirements:

• Hands-on experience with Unix/Linux

• Good knowledge of SQL

• Experience with Git and Jenkins

• Experience working with different applications and their configurations

• Strong troubleshooting skills and analytical, rational thinking

• Experience working in an Agile environment

• Fluent English

Nice to have:

• Experience with Hadoop or other big data platforms

• Experience with the ARC Ingestion Framework or other data ingestion tools

• Testing experience, including Robot Framework

• Basic Python knowledge

• Familiarity with Jira, Confluence and Helix