Empleos de ai evaluation engineer en Madrid

Astek Iberia busca un Ingeniero de Software con experiencia en IA para liderar la adopción de prácticas de codificación asistida por IA en sus equipos de ingeniería. El rol combina desarrollo práctico, coaching y gobernanza para escalar el uso de IA en software. Se requieren 5–10 años de experiencia, habilidades en Python y TypeScript/JavaScript,...

Buscamos un/a Senior Python Developer con experiencia en desarrollo backend y conocimientos en Inteligencia Artificial Generativa, LLMs, arquitecturas de agentes y evaluación de modelos, para incorporarse a un proyecto tecnológico de alto nivel. REQUISITOS: Arquitecturas de Agentes Planning, Tool Calling y Function Calling. Memory y Context...

Intellias seeks a Senior ML / Evaluation Engineer to define and implement enterprise-grade evaluation standards for AI agents and LLM-powered applications. You will design evaluation frameworks, build custom evaluation pipelines, and establish automated quality gates across the AI delivery lifecycle. Collaborate with AI Platform Engineers, ML Engineers, and...

AI engineer role in Madrid focused on building virtual environments and evaluating AI agent code. Requires Computer Science degree and 5+ years of software development experience, particularly in Python, FastAPI, and React.

Descripción de la empresaInetum es líder europeo en servicios digitales. El equipo de 28.000 consultores y expertos de Inetum se esfuerza cada día por lograr un impacto digital en las empresas, en las entidades del sector público y en la sociedad. Las soluciones de Inetum quieren contribuir al rendimiento y la innovación de sus clientes, así como al...

Inetum es líder europeo en servicios digitales. El equipo de 28.000 consultores y expertos de Inetum se esfuerza cada día por lograr un impacto digital en las empresas, en las entidades del sector público y en la sociedad. Las soluciones de Inetum quieren contribuir al rendimiento y la innovación de sus clientes, así como al interés general. Presente...

DLocal is seeking a senior technologist to validate high-value AI and automation technologies, running instrumented LLM experiments, prototypes, and benchmarks to de-risk adoption across the company.You will design evaluation environments, build tooling, write concise decision memos, mentor engineers, and collaborate with Security, Legal, Compliance and...

JetBrains is looking for a Research Engineer to enhance AI agents' capabilities with Kotlin. In this role, you'll analyze agent failures, build and maintain evaluation pipelines, and collaborate with leading model providers. Ideal candidates have a strong coding background, especially in Python, and familiarity with Kotlin.The position offers competitive...

Mercor is seeking experienced music producers and audio engineers to evaluate generative music AI models. You will assess AI-generated music in Spanish (ES) and English, focusing on musicality, creativity, and technical quality. Responsibilities include head-to-head comparisons, tagging by genre and structure, and evaluating lyrics and vocal quality against...

Intellias Barcelona busca un Ingeniero Senior de ML / Evaluación para definir y aplicar estándares de calidad en IA y LLMs. Diseñará marcos de evaluación, pipelines y puertas automáticas, trabajando con equipos de AI Platform, ML y DevOps para sistemas de IA fiables y observables. El rol se desempeñará en un entorno remoto desde España, con contrato...

Synthires is seeking experienced Frontend Software Engineers and Full-Stack Developers to evaluate AI-generated web interfaces and code. The role focuses on comparing AI outputs to real reference sites, judging visual fidelity and code quality. Candidates should analyze HTML structure, CSS architecture, responsiveness, and maintainability, and identify...

Synthires seeks an AI Engineer for a part-time, hourly contract. The role centers on building RL environments to evaluate AI models within software engineering workflows. You’ll debug, refactor code, and optimize performance across C++, Python, Java, and more, while using MCP-based tooling in a fully remote setup. Ideal candidates excel in algorithms, data...

Agilent Technologies Spain S.L. seeks a senior AI governance specialist to design and operate responsible AI practices across the enterprise AI stack. You will develop risk-based governance, evaluation methodologies, and compliance controls for safe deployment of AI models and agents, working with engineering, legal, quality, and security teams. You will...

Synthires is seeking a Frontend Software Engineer for a remote, freelance hourly contract to evaluate AI-generated web interfaces and code. You will compare AI outputs against reference sites, assess HTML structure, CSS, responsiveness, and provide precise, evidence-based evaluations. The role focuses on identifying shortcuts and maintaining high-quality...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback. Responsibilities Evaluate...

Mercor is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.Join a team collaborating with AI researchers and safety groups to advance...

We are seeking experiencedAI Safety Practitionersto evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.ResponsibilitiesEvaluate...

AI Agent Evaluation Analyst (Freelance)Inscríbase (haciendo clic en el botón correspondiente) después de revisar toda la información relacionada con el trabajo a continuación.Mindrift, Madrid, Community of Madrid, SpainThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates....

Descripción del trabajoAt ASTEK Iberia, we are looking for a highly skilled Software Engineer specialized in AI-assisted development to lead the adoption of modern AI coding practices across our engineering teams ¿Posee las habilidades y la experiencia adecuadas para este puesto? Siga leyendo para descubrirlo y envíe su solicitud. into a large-scale...

Intellias busca un Senior ML / Evaluation Engineer para definir e implementar estándares de calidad en agentes de IA y aplicaciones con LLM. Diseñarás marcos de evaluación, pipelines y puertas de calidad en el ciclo de entrega de IA, trabajando con equipos de AI Platform, ML y DevOps para garantizar sistemas productivos y medibles. La posición se ofrece...