Remote AI Evaluation Engineer

Jobgether is seeking a founding AI Evaluation Engineer based in Spain to design and build scalable evaluation and observability infrastructure for AI agents. You will create automated testing for complex reasoning, multi-turn conversations, and API interactions, driving reliability and safety across production systems. You will own the evaluation...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Spain.As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably, safely,...

AI Evaluation SpecialistRole Type:Contractor Location:Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experiencedAI Evaluation Specialiststo assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Spain. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably, safely,...

NTT DATA seeks experienced Research Engineers to contribute to a project focused on code generation, software engineering, and AI model evaluation. You will develop, review, and assess real-world coding tasks to train next-generation AI systems. No prior AI experience required. Role is remote with fast onboarding and flexible collaboration across teams....

Descripción de la empresaInetum es líder europeo en servicios digitales. El equipo de 28.000 consultores y expertos de Inetum se esfuerza cada día por lograr un impacto digital en las empresas, en las entidades del sector público y en la sociedad. Las soluciones de Inetum quieren contribuir al rendimiento y la innovación de sus clientes, así como al...

YO AI Labs is seeking an AI Evaluation Specialist to assess AI outputs against detailed rubrics and provide actionable feedback. The role focuses on consistency, accuracy, and fairness, with strong emphasis on independent, high-volume evaluation tasks.Applicants should have experience in quality assurance or editorial review and be proficient with AI tools...

YO AI Labs is seeking experienced Research Engineers to contribute to code generation, software engineering, and AI model evaluation. You will apply programming expertise to develop, review, and evaluate real-world coding tasks that help train and improve next-generation AI systems. No prior AI experience is required. Role focuses on analyzing and refining...

AI Evaluation SpecialistRole Type:ContractorLocation:Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experiencedAI Evaluation Specialiststo assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and provide...