AI Evaluation Engineer

We are looking for a QA Engineer or Software Development Engineer in Test (SDET) who shares the same values of pragmatism, professionalism, and transparency that we do. Working from anywhere in Spain, we support our clients in many ways and you will have the opportunity to work on a wide range of projects. You will evaluate, validate and improve quality...

AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

Sovrano AI is seeking a remote, hourly evaluator to review Mandarin AI responses for accuracy, fluency, and cultural fit. You will assess and compare answers, then craft strong model responses to guide learning.You'll flag errors, log biases, and explain fixes to improve future outputs, ensuring tone, terminology, and nuance align with a Chinese audience....

Finom is seeking a founding IC for its AI Team focused on quality, evaluation, and telemetry of AI agents powering Finom's internal operations and tools across ~20 core processes.You will extend evaluation suites, enforce pre-launch quality gates in CI/CD, and work with domain experts to label cases and resolve disagreements. You will build datasets from...

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote, contract-based engagement to evaluate and improve AI system outputs. You will assess AI-generated specifications, release notes, and user-facing content, providing detailed rationales and actionable feedback.Candidates should have strong product management or ownership...

You'll join Finom's AI Team as the founding IC dedicated to the quality, evaluation and telemetry of AI agents powering Finom's internal operations and tools (including Ops workflows and internal AI analytics engines across ~20 core processes) Own and extend our offline/online evaluation suites across ~20 internal AI agent processes-datasets (capability +...

Finom’s AI Team seeks a seasoned data scientist to own evaluation methodologies for its internal AI agents. You will design benchmarks, set quality gates, and partner with domain experts to label cases and resolve disagreements.You’ll work with Databricks, Claude Code, and dbt to build robust evaluation pipelines. You will lead the offline and online...

AstraZeneca is hiring an Associate Director, Clinical AI Evaluation and Responsible Deployment to establish evidence systems that determine usefulness, reliability, safety, and scale of clinical AI. You will collaborate with clinical, engineering, IT, and data teams to shape validation strategies and governance across the product lifecycle.You will build...

About FinomFinom is a European tech startup headquartered in Amsterdam, and we’re on a journey towards revolutionizing the financial landscape for entrepreneurs worldwide. Our mission is to develop an all-in-one financial B2B solution that integrates banking functions, accounting, financial management, and invoicing into a seamless, mobile-first...