Opis oferty:

ING Hubs Poland is hiring! We are looking for a Senior Data Engineer with hands-on experience in building complex data pipelines and working with technologies such as Apache Airflow, Spark, Python, SQL, noSQL data stores, object storage services, and deployment automation tools.

You will be working with the Wholesale Banking Advanced Analytics team, which aims to make Wholesale Banking at ING data-driven by combining UX research, engineering, and data science to deliver high-value solutions and products.

Wymagania:

• Hands-on experience building complex data pipelines
• Experience with Apache Airflow, Spark, Python
• Experience in setting up and optimizing SQL and noSQL data stores
• Familiarity with object storage services and deployment automation tools
• Experience in cloud environments would be a plus
• Extensive experience with Spark, Hadoop, SQL & relational databases, GitLab CICD pipelines
• Experience with managing distributed systems and clusters, MLOps architecture, modern data modeling concepts, and large scale data warehousing architecture

Dodatki i korzyści:

• Work with the latest technologies in Data Engineering
• Design and build data pipelines for various stakeholder requirements
• Creative and fun work environment
• Opportunity to work in different global offices of ING