Generative Ai Red Team Engineer

hace 1 semana

Madrid, España buscojobs España A tiempo completo

Help shape the future of ethical AI.

Learn more about Sigma.AI and Sigma Cognition.

We are seeking a highly skilled and innovative Red Team Engineer with expertise in finding Generative AI vulnerabilities to join our adversarial testing team. The ideal candidate will have a strong background in red teaming, adversarial attacks, and generative AI, particularly in testing the robustness and security of large-scale generative models. This role will focus on identifying vulnerabilities, ethical risks, and adversarial weaknesses in AI systems used for tasks such as natural language generation and other AI-driven applications. Deliverables for this role include the building of a prompt dataset, research and reporting on the evaluation of several generative AI foundation models, and the building of a training program around red teaming.

You will collaborate with AI researchers, product managers, and other engineers to proactively test and improve the resilience of our generative AI systems against real-world threats, including prompt injection attacks, data poisoning, and bias exploitation. You will also play a key role in driving red teaming best practices, ethical alignment, and safeguarding the integrity of generative AI models.

Key Responsibilities:

  • Adversarial planning and testing: Design, plan, and execute red teaming assessments focused on generative AI models to simulate adversarial attacks, prompt injections, and other potential misuse scenarios.
  • Threat Emulation: Conduct threat emulation and create real-world attack scenarios for generative AI models, focusing on vulnerabilities such as data poisoning, model drift, and ethical boundary violations.
  • Collaborate with AI Teams: Work closely with machine learning engineers, data scientists, product managers, and AI researchers to evaluate model performance under adversarial conditions and provide actionable recommendations for strengthening AI defenses.
  • Ethical Testing & Bias Audits: Evaluate AI models for potential ethical concerns, including bias detection and unintended harmful behavior, and work to align AI systems with ethical guidelines.
  • Documentation & Reporting: Produce detailed reports outlining identified vulnerabilities, exploit scenarios, and recommendations for improvements, including post-mortems of red teaming exercises.
  • Creation of a training program: Develop, in collaboration with project managers and machine learning engineers, a training program to train and upskill a team that would be able to carry out red teaming assessments.
  • Stay Current: Stay up-to-date on cutting-edge AI security research, adversarial machine learning techniques, and ethical AI frameworks to ensure robust red teaming practices.

Qualifications:

  • Education: Advanced degree (e.g., Master’s degree or PhD) in Computer Science, Machine Learning, Cybersecurity, or a related field. Equivalent work experience will also be considered.
  • Experience: 2+ years of experience in red teaming with at least one year spent on the evaluation of generative AI models (e.g., natural language processing, image generation) and the security challenges they present. Proven track record of conducting adversarial attacks and identifying vulnerabilities in AI models.
  • Technical Skills: Strong programming skills in languages such as Python and familiarity with machine learning libraries and adversarial prompt datasets. Experience with adversarial machine learning techniques, including prompt injections, model poisoning, and data exfiltration. Experience with AI ethics and bias testing in model outputs.
  • Other Skills: Excellent problem-solving skills with the ability to think like an adversary and design creative attack strategies. Effective communication skills to explain complex AI vulnerabilities to stakeholders and provide clear, actionable recommendations.

Preferred Qualifications:

  • Knowledge of AI Regulatory Standards: Familiarity with emerging AI governance and security standards, including ethical AI frameworks and AI governance best practices.
#J-18808-Ljbffr

  • Generative Ai Red Team Engineer

    hace 2 semanas

    Madrid, España Sigma Group A tiempo completo

    Help shape the future of ethical AI.  Learn more about Sigma.AI and Sigma Cognition .We are seeking a highly skilled and innovative Red Team Engineer with expertise in finding Generative AI vulnerabilities to join our adversarial testing team.The ideal candidate will have a strong background in red teaming, adversarial attacks, and generative AI,...

  • Generative Ai Red Team Engineer

    hace 1 semana

    Madrid, España buscojobs España A tiempo completo

    Help shape the future of ethical AI.Learn more about Sigma.AI and Sigma Cognition.We are seeking a highly skilled and innovative Red Team Engineer with expertise in finding Generative AI vulnerabilities to join our adversarial testing team. The ideal candidate will have a strong background in red teaming, adversarial attacks, and generative AI, particularly...

  • Generative Ai Red Team Engineer

    hace 3 semanas

    Madrid, España Sigma Group A tiempo completo

    You will collaborate with AI researchers, product managers, and other engineers to proactively test and improve the resilience of our generative AI systems against real-world threats, including prompt injection attacks, data poisoning, and bias exploitation. You will also play a key role in driving red teaming best practices, ethical alignment, and...

  • AI Engineer

    hace 3 semanas

    Madrid, Madrid, España Unbabel A tiempo completo

    About UnbabelAt Unbabel, we're revolutionizing communication for people with disabilities by developing cutting-edge generative AI applications. We're seeking a talented AI Engineer to join our Halo team and contribute to building a product that makes a real difference in people's lives.Key Responsibilities• Acquire knowledge and design techniques for...

  • DevOps Engineer

    hace 6 meses

    Madrid, España Adyen A tiempo completo

    This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for amb Adyen seeks a MLOps or DevOps Engineer to join our Generative AI team in Madrid. The mission of this team is...

  • Technical Innovator

    hace 3 semanas

    Madrid, Madrid, España Amazon A tiempo completo

    About the RoleWe are seeking a talented Software Development Engineer to join our team and contribute to the advancement of Amazon's generative AI capabilities. As a Technical Innovator, you will be responsible for designing, developing, and operating generative AI-based solutions for the Amazon Store.

  • Ml Engineer, Generative Ai Innovation Center

    hace 2 meses

    Madrid, España Amazon A tiempo completo

    ML Engineer, Generative AI Innovation CenterJob ID: 2660970 | AWS EMEA SARL (Italy Branch) - G99The Generative AI Innovation Center at AWS helps AWS customers accelerate the use of Generative AI and realize transformational business opportunities. This is a cross-functional team of ML scientists, engineers, architects, and strategists working step-by-step...

  • Ml Engineer, Generative Ai Innovation Center

    hace 2 meses

    Madrid, España Amazon A tiempo completo

    ML Engineer, Generative AI Innovation CenterJob ID: 2660970 | AWS EMEA SARL (Italy Branch) - G99The Generative AI Innovation Center at AWS helps AWS customers accelerate the use of Generative AI and realize transformational business opportunities. This is a cross-functional team of ML scientists, engineers, architects, and strategists working step-by-step...

  • Ml Engineer, Generative Ai Innovation Center

    hace 2 meses

    Madrid, España Amazon A tiempo completo

    ML Engineer, Generative AI Innovation Center Job ID: 2660970 | AWS EMEA SARL (Italy Branch) - G99 The Generative AI Innovation Center at AWS helps AWS customers accelerate the use of Generative AI and realize transformational business opportunities.This is a cross-functional team of ML scientists, engineers, architects, and strategists working step-by-step...

  • AI Generative Model Developer

    hace 3 semanas

    Madrid, Madrid, España Nielseniq A tiempo completo

    Job OverviewWe are seeking a highly skilled American Senior Machine Learning Engineer to join our innovative team in Spain. The selected candidate will be responsible for developing cutting-edge generative AI solutions, pushing the boundaries of what's possible in machine learning and artificial intelligence.About NielseniqNielseniq is the world's leading...

  • DevOps Engineer

    hace 4 meses

    Madrid, España Adyen A tiempo completo

    DevOps Engineer - Generative AI Team **This is Adyen** Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for amb **Key responsibilities**: - Collaborate with the team to design and...

  • Highly Skilled Generative AI Software Engineer

    hace 3 semanas

    Madrid, Madrid, España Unbabel A tiempo completo

    Company Overview:Halo is a cutting-edge technology that revolutionizes human communication, particularly for those who face challenges in expressing themselves. Our mission at Unbabel is to harness the power of artificial intelligence to create a more inclusive and connected world.About Us:We are a dynamic and ambitious team dedicated to pushing the...

  • Senior Machine Learning Engineer

    hace 3 semanas

    Madrid, Madrid, España Next Ventures A tiempo completo

    OverviewNext Ventures is a leading player in the Business Intelligence and Data Recruitment industry, with a strong presence in Spain. We are currently seeking a highly skilled Senior Machine Learning Engineer - Generative AI to join our team. SalaryWe offer a competitive salary of €85,000 per annum, reflecting the high demand for experienced...

  • Machine Learning Engineer for Generative AI Solutions

    hace 4 semanas

    Madrid, Madrid, España Amazon A tiempo completo

    Amazon's AWS Global Support team is responsible for delivering world-class support to our customers. As an Applied Scientist in the Generative Artificial Intelligence (AI) Innovation Center, you'll have the opportunity to innovate and contribute to game-changing projects leveraging cutting-edge generative AI algorithms.**Key Responsibilities:**•...

  • Leading Generative AI Architect and Innovator

    hace 7 días

    Madrid, Madrid, España Amazon A tiempo completo

    The Generative AI Innovation Center at Amazon Web Services (AWS) is a hub for accelerating the use of generative AI and driving transformational business opportunities.This cross-functional team of ML scientists, engineers, architects, and strategists work closely with customers to build bespoke solutions that harness the power of generative AI.As a Senior...

  • Machine Learning Innovator, Generative AI Solutions Expert

    hace 2 semanas

    Madrid, Madrid, España Amazon A tiempo completo

    About the RoleA challenging opportunity has arisen for a Senior Deep Learning Architect to join Amazon's Generative AI Innovation Center. As a key member of our team, you will partner with technology and business teams to design, develop, and implement cutting-edge generative AI solutions that surprise and delight our customers.Job...

  • Tech Lead – Generative Ai

    hace 3 semanas

    Madrid, España Amadeus A tiempo completo

    .Job TitleTech Lead – Generative AI (GenAI)Summary :As the Tech Lead for Generative AI, you will play a pivotal role in designing, developing, and leading the deployment of innovative AI solutions. Acting as a technical authority, you'll collaborate with business and IT stakeholders to evaluate AI use cases, establish best practices for testing and...

  • Digital Transformation Engineer for Generative AI Solutions

    hace 2 días

    Madrid, Madrid, España Picsart A tiempo completo

    Picsart is a leading digital creation platform empowering users worldwide to express their creativity through innovative tools. As a Senior Web Software Engineer on our Generative AI team, you'll play a pivotal role in developing scalable web applications that drive user engagement.We're seeking an experienced JavaScript Engineer with a passion for React.js...

  • Technical Leader

    hace 1 mes

    Madrid, España Inetum A tiempo completo

    Technical Leader - Generative AI Business Unit Role Overview: Inetum is seeking a dynamic and experienced Technical Leader to join our Generative AI Business Unit.As a Technical Leader, you will lead a team of developers, leveraging Generative Artificial Intelligence technologies in projects to drive innovation and deliver cutting-edge solutions.Key...

  • Senior Generative AI Solutions Architect

    hace 2 semanas

    Madrid, Madrid, España Amazon A tiempo completo

    Job Overview:A challenging opportunity has arisen to work with Amazon Web Services (AWS) as a Data Scientist in the AWS Industries team.This is an exciting chance to apply cutting-edge generative AI algorithms to solve real-world problems and drive significant business impact for AWS customers.The AWS Industries team collaborates with data scientists,...