Opis oferty:
The Data Engineer will be responsible for designing, building, and managing the data infrastructure and data pipeline processes for the bank. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a thorough understanding of the banking industry's data requirements.
Wymagania:
- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
- Sound knowledge on working Unix/Linux Platform.
- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
- Understanding of big data modelling techniques using relational and non-relational techniques.
- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
- Experience with: time-series/analytics dB’s such as Elastic search, scheduling tools such as Airflow, Control-M, understanding of Cloud design patterns, developing Hive QL, UDF’s for analysing semi structured/structured datasets.
- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
Dodatki i korzyści:
- Competitive salary
- Annual performance-based bonus
- Additional bonuses for recognition awards
- Multisport card
- Private medical care
- Life insurance
- One-time reimbursement of home office set-up (up to 800 PLN).
- Corporate parties & events
- CSR initiatives
- Nursery discounts
- Financial support with trainings and education
- Social fund
- Flexible working hours
- Free parking