Big Data Engineer

Deine Rolle im Team

Aufgabenverteilung

Unsere Erwartungen an dich

Ausbildung

• You finished your BSc/MSc/PhD in a related field, e.g. Computer Science with at least one year professional experience in a Software or Data Engineering environment

Qualifikationen

• You have a good understanding of big data infrastructures and (private) cloud architectures (migration from on-premise to cloud)
• You have solid experience with software and data engineering best practices such as Git, CI/CD (Jenkins), DevOps, Data Quality, Data Governance and Infrastructure as Code
• You are familiar with the following programming languages and technologies: Python, SQL and Spark
• You feel confident in implementing productive data engineering solutions, including data quality, orchestration and schema management
• You have already gained experience with automation tools (Ansible) and cloud deployments (ideally with Azure)
• You have an open personality, can explain technical topics well and like to be in direct contact with technicians at our customers, you also want to make a significant contribution to craftworks' success story
• You are enthusiastic about developing high-quality, production-ready software
• English language proficiency required and knowledge of German is a plus
• Technology and knowledge: Python, Java, Apache Spark (Hive, Spark, Kafka), Azure, Azure DevOps, Databricks, Synapse, Purview, VMs (Linux), Docker, Kubernetes, Airflow