Intern AI Evaluation Engineering (f/m/d)

Job description

The AI Centre of Enablement (AI CoE) team at AllianzGI builds and operates GenAI Hub.

The intern will join the core engineering team in Paris to design and implement a comprehensive evaluation and optimisation framework for GenAI Hub's AI pipelines. This role sits at the intersection of applied ML research and production engineering, with direct impact on the quality, reliability, and safety of AI features used across the organisation.

What you do

• Conduct a structured benchmark of GenAI evaluation frameworks,  both open-source (Ragas, DeepEval, TruLens, Phoenix/Arize, ARES, promptfoo) and commercial SaaS platforms (LangSmith, Braintrust, Humanloop, Galileo, Azure AI Evaluation); Compare metrics coverage, ease of integration, cost, licensing, scalability, and enterprise readiness
• Curate a gold-standard evaluation dataset (queries, expected outputs, source documents, edge cases) across GenAI Hub's core features
• Implement evaluation pipelines using the top 2–3 frameworks, measuring faithfulness, answer relevance, context precision, context recall, hallucination rate, and task-specific quality metrics
• Produce a quality baseline report identifying strengths and weaknesses per feature and per search index, with cross-framework comparison of metric consistency
• Experiment with programmatic prompt optimization tools (DSPy, TextGrad, MIPRO) to automatically improve retrieval and generation quality against the established baseline
• Integrate Responsible AI considerations into the evaluation framework — assessing outputs for bias, toxicity, fairness, and content safety — and recommend guardrails and automated checks for production deployments
• Deliver a tool selection recommendation, a reusable evaluation harness, optimized prompt candidates, and a comparative benchmark report (before/after) with cost/quality/safety trade-off analysis.

What you bring

• Currently pursuing M1/M2 in Data Science, Machine Learning, Computer Science, or a related field
• Solid Python programming skills (scripting, data manipulation, API integration)
• Foundational understanding of NLP/ML concepts (embeddings, language models, retrieval systems)
• Familiarity with evaluation methodology and metrics design
• Ability to synthesize findings from multiple tools and produce clear, structured written reports
• Curiosity for applied research, tooling evaluation, and emerging AI practices
• Working proficiency in English (French is a plus)
• No prior enterprise experience required.

What we offer

• Balanced work environment: A dynamic office culture that supports flexibility and collaboration
• Support for what matters: Mental health and wellbeing programs
• Investments in your career: Career opportunities within the entire Allianz Group
• Investments in your skills: Comprehensive learning and development offerings, including certifications and professional qualifications
• … and so much more!

About Allianz Global Investors 

Allianz Global Investors is a leading active asset manager, managing assets for individuals, families, and institutions worldwide. Our goal is to actively shape the future of investing for all our clients, wherever their location and whatever their objectives.  

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us.   

At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating equal opportunities for all. And the foundation for this is our inclusive workplace, where people and performance both matter, and nurtures a culture grounded in integrity, fairness, inclusion and trust. 

We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.  

If you feel inspired to promote the active asset management experience, this is the place for you. Join our international, technology-enabled, and agile environment. Simply upload your CV in English to apply for this position.  If you need support to navigate our websites or at any stage during your application, please send an email with your request to recruiting@allianzgi.com  

Great to have you on board. Let’s care for tomorrow.