AI Validation Engineer

As AI-powered features become central to automotive vehicles — from ADAS perception and voice assistants to predictive diagnostics and intelligent infotainment — rigorous validation of these systems is critical for successful deployment. We are seeking a Senior AI Validation Engineer to design and implement testing strategies, frameworks, and automated pipelines that ensure the quality, safety, and reliability of deep learning and LLM-based features across vehicle platforms.

This role sits at the intersection of AI/ML engineering and automotive system validation. You will build the tools, datasets, and evaluation methodologies that enable confident delivery of AI-driven automotive solutions.

Key Responsibilities

• Design and implement validation frameworks for deep learning models (perception, NLP, generative AI) deployed in automotive systems, covering accuracy, robustness, latency, and safety metrics.
• Develop automated test pipelines for LLM-based features, including hallucination detection, response quality evaluation, prompt regression testing, and adversarial input testing.
• Build and curate evaluation datasets and benchmarks tailored to automotive AI use cases (e.g., voice commands, diagnostic Q&A, sensor fusion outputs).
• Create AI-assisted test generation tools that leverage LLMs to automatically produce test cases, test data, and expected-result specifications from system requirements.
• Develop model monitoring and drift detection systems for AI features running in production and test environments.
• Collaborate with system architects to integrate AI model validation into existing test bench infrastructure and CI/CD pipelines.
• Implement automated regression testing for ML model updates, ensuring backward compatibility and performance parity across software releases.
• Analyze test results using statistical methods and ML techniques to identify root causes, failure patterns, and quality trends.
• Work in cross-functional Agile teams spanning AI/ML, embedded software, and system integration disciplines.

Basic Qualifications

• Bachelor’s degree in computer science, Machine Learning, Data Science, Electrical Engineering, or a related field.
• Minimum of 5 years of experience in ML/AI development, with a minimum of 2 years focused on model evaluation, testing, or validation.
• Strong proficiency in Python and testing/automation frameworks (pytest, Robot Framework, or equivalent).
• Hands-on experience evaluating deep learning models — including metrics design, dataset curation, bias/fairness analysis, and regression testing.
• Experience with LLM evaluation techniques (BLEU, ROUGE, human-in-the-loop evaluation, LLM-as-judge approaches).
• Familiarity with ML experiment tracking and pipeline orchestration tools (MLflow, Weights & Biases, Kubeflow, or equivalent).
• Experience with CI/CD systems (Jenkins, GitLab CI, GitHub Actions) for automated test execution.
• Strong analytical and communication skills with the ability to translate AI validation results into actionable insights for engineering teams.

Preferred Qualifications

• Master's in Computer Science, Machine Learning, or a related field.
• Experience with simulation-based testing or digital twin environments.
• Familiarity with automotive test toolchains (dSpace, Vector CANoe, NI VeriStand) is a plus but not required.
• Ability to collaborate effectively across time zones with global engineering teams.
• Knowledge of automotive safety standards (ISO 26262, SOTIF/ISO 21448) as applied to AI systems.
• Experience with adversarial robustness testing, out-of-distribution detection, or uncertainty quantification for neural networks.

Our Benefits — Designed With You In Mind

Comprehensive Health & Well-being Coverage

From your very first day, you’ll have access to medical, dental, vision, and prescription drug coverage — ensuring you and your family stay healthy and protected. Also, our Employee Assistance Program (EAP) offers confidential support for personal and professional challenges, always ready when you need it.

Family Building Benefit

We proudly support all paths to parenthood- including fertility and infertility treatments, adoption services, and gestational surrogacy.

Generous Paid Time Off

We believe in work-life balance. That’s why we offer: 17+ paid holidays, including shut-down from December 24th through New Years Day every year. Vacation, float & wellbeing days, sick time and fully paid parental leave when your family needs you most.

Competitive Retirement Savings Plans

We Help You Plan For The Future With

• An employer match on contributions to your 401k, Roth, and Catch-Up plans
• An employer contribution, even if you don’t contribute

Income Protection & Insurance Options

Benefit from both employer-provided and voluntary plan offerings, including life insurance, group accident, critical illness, etc. - supporting the needs of you and your family and ensuring peace of mind.

Company Vehicle Lease Program

Eligible employees and their immediate families can participate in the company vehicle lease program, providing access to Stellantis vehicles with insurance, maintenance, and unlimited miles included. Plus, take advantage of exclusive discounts on Stellantis products.

Support for Your Growth and Giving Back

We believe in investing in your future and your passions:

• Tuition reimbursement
• Student loan refinancing programs
• 18 paid volunteer hours each year to make a difference in your community

And so much more!

When you join us, you’re not just building a career — you’re joining a company that supports you, inside and outside of work.

At Stellantis, we assess candidates based on qualifications, merit, and business needs. We welcome applications from all people without regard to sex, age, ethnicity, nationality, religion, sexual orientation, disability, or any characteristic protected by law. We believe that diverse teams reflect our identity as a global company, enabling us to better address the evolving needs of our customers and care for our future.

EOE / Disability / Veteran