Technical Data Engineer

Job description

Key responsibilities

 

Within the Data Platform and Engineering team, the Technical Data Engineer must have a strong and certified experience in Microsoft Azure and especially Azure Databricks. Through this position you will be part of an Engineering team in charge to set up, configure, deliver and maintain the target data platform of Allianz Partners, based on Azure Databricks and related services.

 

As a Technical Data Engineer you are in charge of the following responsibilities: 
 

·  Design and implement scalable data pipelines and ETL processes for Business Intelligence (BI), advanced analytics, and operational uses.
·  Develop and maintain data warehouses and data lakes.
·  Monitor, troubleshoot, and optimize data pipelines for high performance and capacity standards.
·  Ensure data quality, integrity, and security across all data engineering processes.
·  Integrate and consolidate data from various sources.
·  Migrate existing infrastructure services to cloud-based solutions.
·  Support cloud adoption of applications as they are being transformed and/or modernized.
·  Collaborate with cross-functional teams (Product Owners, Data Analysts, Domain Experts, Data Scientists and IT Engineers) to understand data needs and business demands, translate them to requirements and provide solutions.
·  Advocate for data-driven decision-making, educating stakeholders on data capabilities, and aligning data infrastructure with business goals to maximize the value of data assets across the organization.
                                                     

What you bring   

 

·  Bachelor’s degree in computer science, information systems, or a related field.
·  3+ years of Microsoft Azure experience involving design, deployment, configuration and optimization.
·  2+ years of Databricks knowledge is highly appreciated. 
·  Proficiency in Apache Spark and Delta Lake for large-scale data processing.
·  Expertise in designing and implementing ETL pipelines and workflows using Spark SQL, Python and Delta Live Tables.
·  Knowledge of data modeling (medallion architecture) and optimization techniques for Lakehouse architectures.
·  Experience in Data Integration services including Azure Data Factory and Azure DevOps - Oracle and Informatica is a plus.
·  Familiarity with Data Governance and Security Practices using Unity catalog (RBAC, monitoring, data quality) and role-based access control (RBAC) are a plus.
·  Work experience in an Agile framework.
·  Excellent communication skills, both written and verbal, with a keen attention to detail.
·  Values diversity and comfortable in complex multicultural environments.
·  Business skills in the Financial/Insurance environment are a plus.
·  Fluency in English.

What we offer   

 

Our employees play an integral part in our success as a business. We appreciate that each of our employees are unique and have unique needs, ambitions and we enjoy being a part of their journey.

We are there to empower and encourage you with your personal and professional development ensuring  that you take control by offering a large variety of courses and targeted development programs.

All that in a global environment where international mobility and career progression are encouraged. Caring for your health and wellbeing is key priority for us. This is why we build Work Well programs to providing you with peace of mind and give the flexibility in planning and arranging for a better work-life balance. 

 

61104 | Operations | Professional | Non-Executive | Allianz Partners | Full-Time | Permanent

 

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us. 

We at Allianz believe in a diverse and inclusive workforce and are proud to be an equal opportunity employer. We encourage you to bring your whole self to work, no matter where you are from, what you look like, who you love or what you believe in.
We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation. Great to have you on board. Let's care for tomorrow.

Note: Diversity of minds is an integral part of Allianz’ company culture. One means to achieve diverse teams is a regular rotation of Allianz Executive employees across functions, Allianz entities and geographies. Therefore, the company encourages its employees to have motivation in gaining varied skills from different positions and to collect experiences from across Allianz Group.