Opis oferty:

Data Engineer with analytical skills. We are looking for you if you have experience with Apache Airflow, Spark, Python, experience in building Azure, GitLab CICD pipelines, hands-on experience building complex ETL data pipelines, experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3), can manage accesses, data, and code repository (code review and testing on Azure DevOps), have excellent communication skills, including being able to explain technical terms to a non-technical audience.

You'll get extra points for financial knowledge about transaction analysis, experience of applying data analysis and data science in the financial sector.

Wymagania:

• Experience with Apache Airflow, Spark, Python
• Experience in building Azure, GitLab CICD pipelines
• Hands-on experience building complex ETL data pipelines
• Experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3)
• Ability to manage accesses, data, and code repository (code review and testing on Azure DevOps)
• Excellent communication skills, including the ability to explain technical terms to a non-technical audience

Dodatki i korzyści:

• Work with the latest concepts and technologies in the field of Data Engineering
• Opportunity to design and build data pipelines for various use cases
• Collaborate with data analysts and UX researchers to create the best user experience and insights for users
• Implementing new features in Kedro/PySpark, testing them in Apache Airflow, deploying them in an in-house platform running on Kubernetes, and optimizing data in the permanent data store
• Join a team dedicated to making data driven decisions in a fun and creative environment
• Opportunity for personal and professional growth