Freelance Agent Evaluation Engineer
hace 6 días
Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves While each project involves unique tasks, contributors may: Create structured test cases that simulate complex human workflows Define gold-standard behavior and scoring logic to evaluate agent actions Analyze agent logs, failure modes, and decision paths Work with code repositories and test frameworks to validate your scenarios Iterate on prompts, instructions, and test cases to improve clarity and difficulty Ensure that scenarios are production-ready, easy to run, and reusable What we look for This opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have: 3+ of software development experience with strong Python focus Experience with Git and code repositories Comfortable with structured formats like JSON/YAML for scenario description Understanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation design Familiarity with Docker English proficiency - B2 How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid Project time expectations Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
-
Freelance Agent Evaluation Analyst
hace 1 semana
Barcelona, España Mindrift A tiempo completoThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...
-
Freelance Agent Evaluation Analyst
hace 6 días
Barcelona, España Mindrift A tiempo completo3 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...
-
AI Evaluation Engineer
hace 2 semanas
Barcelona, España Openchip And Software Technologies SL A tiempo completoThe Role: We are seeking an exceptional AI Evaluation Engineer to design, implement, and scale frameworks for assessing the performance, reliability, and trustworthiness of advanced AI systems. This individual will be responsible for developing methodologies and tools to measure model quality across diverse dimensions, such as accuracy, robustness,...
-
AI Evaluation Engineer
hace 2 días
Barcelona, España Openchip & Software Technologies A tiempo completoWe are seeking an exceptional AI Evaluation Engineer to design, implement, and scale frameworks for assessing the performance, reliability, and trustworthiness of advanced AI systems. This individual will be responsible for developing methodologies and tools to measure model quality across diverse dimensions, such as accuracy, robustness, reasoning, safety,...
-
AI Evaluation Engineer
hace 4 días
Barcelona, Barcelona, España OPENCHIP & SOFTWARE TECHNOLOGIES A tiempo completoThe RoleWe are seeking an exceptionalAI Evaluation Engineerto design, implement, and scale frameworks for assessing the performance, reliability, and trustworthiness of advanced AI systems. This individual will be responsible for developing methodologies and tools to measure model quality across diverse dimensions, such as accuracy, robustness, reasoning,...
-
AI Evaluation Engineer
hace 7 días
Hybrid (, Barcelona, Barcelona/Catalunya/Espanya, Spain) Openchip And Software Technologies SL A tiempo completoThe Role:We are seeking an exceptional AI Evaluation Engineer to design, implement, and scale frameworks for assessing the performance, reliability, and trustworthiness of advanced AI systems. This individual will be responsible for developing methodologies and tools to measure model quality across diverse dimensions, such as accuracy, robustness, reasoning,...
-
AI Evaluation Engineer
hace 2 semanas
Barcelona, España OPENCHIP & SOFTWARE TECHNOLOGIES A tiempo completoWe are seeking an exceptionalLa descripción completa del puesto cubre todas las habilidades asociadas, la experiencia previa y cualquier cualificación que se espera que tengan los solicitantes.AI Evaluation Engineerto design, implement, and scale frameworks for assessing the performance, reliability, and trustworthiness of advanced AI systems. This...
-
AI Engineer/Scientist
hace 2 días
Barcelona, España Axiomatic_AI A tiempo completoAbout Us Axiomatic AI is building a new class of AI systems designed to reason with the rigor of the scientific method. By combining deep learning with formal logic and physics-based modeling, we create verifiable, interpretable AI systems that collaborate with and support human researchers in high-stakes scientific and engineering workflows.Our mission,...
-
Evaluation Scenario Writer
hace 2 semanas
Barcelona, España Mindrift A tiempo completoThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What we...
-
AI Engineer
hace 1 día
Barcelona, España Stott and May A tiempo completoAI Engineer – Remote (Barcelona) | €100,000Si está considerando enviar una solicitud, asegúrese de pulsar el botón de solicitar de abajo después de leer la descripción completa.About the Role We are looking for a hands-on AI Engineer to own and evolve the core “brain” service that drives a cutting-edge AI product. This role spans architecture,...
