Talent.com
Amaris Consulting
Senior Test & Verification Lead AI (LLM/VLM)Amaris Consulting • Eindhoven, Netherlands
Senior Test & Verification Lead AI (LLM/VLM)

Senior Test & Verification Lead AI (LLM/VLM)

Amaris Consulting • Eindhoven, Netherlands
21 dagen geleden
Functieomschrijving

Job description

About the Role

We are looking for a Senior Test & Verification Lead to own the verification and validation strategy for an innovative AI-powered solution.

This is not a traditional software test management position. The role focuses on ensuring that AI models, software components, clinical workflows, and system requirements are appropriately verified, validated, documented, and released in accordance with internal quality standards and regulatory expectations.

You will act as the central authority on test strategy, verification evidence, defect management, and release readiness across engineering, clinical, quality, and regulatory teams.

Key Responsibilities

Verification Strategy & Planning

  • Define and maintain the overall verification and validation strategy for the AI platform.
  • Develop risk-based testing approaches covering AI models, software components, integrations, and clinical workflows.
  • Ensure test activities support both product quality and regulatory requirements.
  • Establish verification criteria, acceptance criteria, and release gates.

Test Management

  • Coordinate and oversee:
    • Functional testing
    • System testing
    • Integration testing
    • Regression testing
    • AI model verification
    • User acceptance testing
  • Ensure adequate test coverage across requirements and identified risks.
  • Monitor testing progress and report quality metrics to stakeholders.

Requirements & Traceability

  • Ensure requirements are traceable through:
    • Design
    • Implementation
    • Verification activities
    • Release decisions
  • Maintain clear linkage between requirements, test cases, defects, and evidence.
  • Identify verification gaps and coordinate remediation.

AI Verification & Performance Validation

  • Review and challenge AI model performance evidence.
  • Ensure verification activities adequately assess:
    • Performance
    • Robustness
    • Reliability
    • Edge cases
    • Bias and fairness considerations
  • Coordinate with AI and clinical teams to validate findings and performance claims.

Required Experience

  • 8+ years in LLM engineering, Data Science, ML, VLM, or GenAI.
  • Experience leading verification activities in regulated or high-assurance environments.
  • Strong understanding of:
    • Test strategy development
    • Risk-based testing
    • Verification & validation methodologies
    • Defect management
    • Traceability management
  • Experience working across engineering, quality, and business stakeholders.
  • Ability to operate independently and challenge decisions when quality risks exist.

Who are we?

Amaris Consulting is an independent technology consulting firm providing guidance and solutions to businesses. With more than 1,000 clients across the globe, we have been rolling out solutions in major projects for over a decade – this is made possible by an international team of 7,600 people spread across 5 continents and more than 60 countries. Our solutions focus on four different Business Lines: Information System & Digital, Telecom, Life Sciences and Engineering. We’re focused on building and nurturing a top talent community where all our team members can achieve their full potential. Amaris is your steppingstone to cross rivers of change, meet challenges and achieve all your projects with success.

At Amaris, we strive to provide our candidates with the best possible recruitment experience. We like to get to know our candidates, challenge them, and be able to give them proper feedback as quickly as possible. Here's what our recruitment process looks like:

Brief Call: Our process typically begins with a brief virtual/phone conversation to get to know you! The objective? Learn about you, understand your motivations, and make sure we have the right job for you!

Interviews (the average number of interviews is 3 - the number may vary depending on the level of seniority required for the position). During the interviews, you will meet people from our team: your line manager of course, but also other people related to your future role. We will talk in depth about you, your experience, and skills, but also about the position and what will be expected of you. Of course, you will also get to know Amaris: our culture, our roots, our teams, and your career opportunities!

Case study: Depending on the position, we may ask you to take a test. This could be a role play, a technical assessment, a problem-solving scenario, etc.

As you know, every person is different and so is every role in a company. That is why we have to adapt accordingly, and the process may differ slightly at times. However, please know that we always put ourselves in the candidate's shoes to ensure they have the best possible experience.
We look forward to meeting you!
Maak een vacature-alert aan voor deze zoekopdracht

Senior Test & Verification Lead AI (LLM/VLM) • Eindhoven, Netherlands

Vergelijkbare banen

Electronics Production Testing Lead

Support Revolution's hertogenbosch, noord brabant, Netherlands

Supermicro is seeking a Production Supervisor to oversee daily manufacturing operations, ensuring smooth and efficient processes while controlling costs and delivering high-quality products.You wil... Laat meer zien

 • Gesponsord

GenAI Team Lead: Drive AI Projects & Growth

ML6eindhoven, noord brabant, Netherlands

ML6 is seeking a senior team lead to drive GenAI initiatives and deliver AI/ML projects with clients across industries.You will lead projects, nurture customer relationships, and act as a trusted a... Laat meer zien

 • Gesponsord

Senior Test Automation Engineer for EV Charging

Siemens eMobilityeindhoven, noord brabant, Netherlands

Siemens eMobility Charging is seeking an experienced Test Automation Engineer to drive automated validation for DC EV charging solutions.You will design scalable frameworks, implement tests for sys... Laat meer zien

 • Gesponsord

Test Lead – Aansturing & Kwaliteit in Agile

CeriosHelvoirt, The Netherlands

Cerios zoekt een Testlead om ons kwaliteitsteam aan te sturen.In deze rol ben je verantwoordelijk voor het vertalen van teststrategieën naar concrete acties binnen complexe IT-omgevingen.Je werkt s... Laat meer zien

 • Gesponsord

Type Test Lead: IEC/UL Compliance & Certification

Siemens eMobilityeindhoven, noord brabant, Netherlands

A leader in electric mobility solutions is seeking a Type Test Lead in Eindhoven, Netherlands, to oversee type-testing and compliance for their innovative charging products.The role demands strong ... Laat meer zien

 • Gesponsord

Astronomer QA Lead (Remote) for AI Training

YO IT Consultingeindhoven, noord brabant, Netherlands
Op afstand

YO IT Consulting is looking for an Astronomer Quality Assurance Lead to oversee quality and performance across astronomy AI projects.You will evaluate AI-generated content for accuracy and ensure a... Laat meer zien

 • Gesponsord

Central QA & Test Lead Engineer: Build Quality In

Enexis Groep B.V.'s hertogenbosch, noord brabant, Netherlands

Central Quality Assurance Test Lead Engineer to enhance organizational capabilities in quality engineering.You will lead quality initiatives, embedding quality into software development and testin... Laat meer zien

 • Gesponsord

Test Architect: Lead Quality & Automation with GenAI

ItilityEindhoven, The Netherlands

Itility in Eindhoven is op zoek naar een ervaren Test Architect die teststrategieën en automation kan samenbrengen.Solliciteer hieronder na het doorlezen van alle details en ondersteunende informat... Laat meer zien

 • Gesponsord

Senior PMM: AI-Driven GTM Leader for SaaS

Limelight HealthEindhoven, The Netherlands

A leading e-commerce shipping platform based in Eindhoven is looking for an experienced Product Marketing professional.Zorg ervoor dat u de volgende details zorgvuldig leest voordat u solliciteert.... Laat meer zien

 • Gesponsord

Senior LLM Architect

IC Resourceseindhoven, noord brabant, Netherlands

Be among the first 25 applicants /ppGet AI-powered advice on this job and more exclusive features.Direct message the job poster from IC Resources /ppAre you a LLM Architect looking for your next po... Laat meer zien

 • Gesponsord

Lead Test Engineer - End-to-End Kwaliteit & Automatisering

Enexis Netbeheer B.V.'s-Hertogenbosch, The Netherlands

Laat deze kans niet voorbijgaan; solliciteer snel als uw ervaring en vaardigheden overeenkomen met wat in de volgende omschrijving staat.Hertogenbosch is op zoek naar een test lead engineer om de t... Laat meer zien

 • Gesponsord

Top level AMS verification engineer

USG Engineeringeindhoven, noord brabant, Netherlands

Job Description /h3 pThe project develops a High End magnetic Speed Sensor for Automotive ABS applications.First engineering samples are available and the project prepares for the redesign being th... Laat meer zien

 • Gesponsord

Senior Test Designer: Lead Automated Testing in High-Tech

DutchHTSeindhoven, noord brabant, Netherlands

DutchHTS in Eindhoven is seeking a (Senior) Test Designer to design and lead the testing approach for high‑tech software products.You will convert test strategies into automated environments and su... Laat meer zien

 • Gesponsord

Senior Test Designer: Automation Lead for High-Tech Systems

Siouxeindhoven, noord brabant, Netherlands

Sioux in Eindhoven is seeking a (Senior) Test Designer to design and lead the testing approach for high-tech software products.You will convert test strategies into automated environments and ensur... Laat meer zien

 • Gesponsord

Senior Test Automation Engineer

Siemens eMobility ChargingEindhoven, North Brabant, Netherlands
Quick Apply

Ready to make EV charging smarter, more reliable, and future-proof?.At Siemens eMobility Charging, you'll help accelerate the transition to sustainable transportation by ensuring the quality, relia... Laat meer zien

Senior Test Automation Engineer

Siemens eMobilityeindhoven, noord brabant, Netherlands

Shape the Future of eMobility /h3 pReady to make EV charging smarter, more reliable, and future‑proof? At Siemens eMobility Charging, you'll help accelerate the transition to sustainable transporta... Laat meer zien

 • Gesponsord

AI Test Engineer

Pancompany's hertogenbosch, noord brabant, Netherlands

Wat ga je doen /h3 pIs het tijd om slimmer te testen? Dan kom jij om de hoek kijken.Als AI Tester ben jij onze nieuwe generatie testautomatiseerder: je gebruikt Artificial Intelligence om testactiv... Laat meer zien

 • Gesponsord

Test Architect / Test Manager

Itilityeindhoven, noord brabant, Netherlands

Bij Itility werken we aan complexe digitale transformaties binnen semicon, energy, manufacturing en retail.Omgevingen waarin applicaties, integraties, data en platformen nauw met elkaar verbonden z... Laat meer zien

 • Gesponsord

Senior AI Engineer (Tech Lead)

ML6Eindhoven, The Netherlands

Senior AI Engineer (Tech Lead).Stop building AI that never meets production.Build systems that actually make impact.Most AI roles stop at tweaking models or working on proof-of-concepts.At ML6, you... Laat meer zien

 • Gesponsord

Senior Photonics Test & Measurement Engineer - Lead

SMART Photonicseindhoven, noord brabant, Netherlands

A leading photonics company in Eindhoven is seeking a Senior Test and Measurement Engineer to develop and optimize production test procedures for Photonic chips.You will be responsible for overseei... Laat meer zien