Opis oferty:
ING Hubs Poland is hiring a Senior Data Engineer to join their team. The role involves designing, implementing, and maintaining an on-premises Cloudera Hadoop-based data platform. You will collaborate with other senior engineers to enhance the platform's capabilities. This hands-on role requires working with a team of Big Data engineers to develop data-driven products.
Wymagania:
- Hands-on experience with Hadoop ecosystem and Confluent Kafka
- Proficiency in Java/Scala, Python, and Ansible
- Experience building batch and streaming data pipelines with Apache Nifi and Spark
- Ability to build microservices and event-driven architecture
- Design and implementation of scalable data platforms
- Knowledge of DevOps practices and tools like Azure DevOps, Test Automation, Docker/Kubernetes
- Understanding of CI/CD concepts and Elastic based monitoring solutions
- Knowledge of relational database concepts and data security
- Understanding of data governance practices
Dodatki i korzyści:
- Competitive salary range of 13000 - 28000 PLN
- Exposure to public cloud platforms like GCP or Azure
- Opportunity to work with an international team
- Engagement in the strategy and lifecycle management of Data Lake implementation