Senior Data Scientist – LLM Expert

This job is with Kyndryl, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The Role Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation. We're looking for exceptional talent to join our AI Agentic Innovation Hub at KyndrylThe AI Agentic Innovation Hub stands as Kyndryl's center of excellence for advanced and agentic artificial intelligence. Our mission is to lead the design and deployment of transformative AI solutions that bridge frontier research with real-world impact - scalable, secure, and driven by measurable value. Built upon a team of exceptional talent andcutting-edgetechnology, the Hub embodies a spirit of bold innovation and disciplined execution - an elite unit within one of the world's leading technology companies. With national reach and global ambition, we partner with major organizations to tackle their most complex challenges, pioneering the next generation of intelligent, autonomous, and trusted systems that redefine what AI can achieve.Job Description As a Senior Data Scientist specialized in Large Language Models at Kyndryl's AI Innovation Hub,you'llhelp shape the frontier of intelligent and agentic systems - turningcutting-edgeresearch into real-world impact for some of the world's most forward-thinking enterprises. You'll work withstate-of-the-arttechnologies, foundation models, and emerging agentic frameworks to design, fine-tune, and deploy powerful LLM-based solutions that understand, reason, and generate language with purpose. In this role,you'llcollaborate closely with architects, ML engineers, and product teams to transform ideas into production-ready systems that redefine how organizations interact with knowledge and automation. You'lloperatein an environment that values experimentation, precision, and creativity - whereyou'llbe encouraged to explore the limits of generative AI, drive technical excellence, and contribute to solutions used by top global clients. Ifyou'repassionate about transforming language models into intelligent agents that can think, act, and assist - this is where your work will make a lasting mark. Your Mission Design, train, fine-tune, and evaluate large language models and their distilled or specialized variants (SLMs).Develop and integrate Generative AI and Agentic AI solutions that combine reasoning, retrieval, and language understanding.Implement andoptimizeRAG (Retrieval-Augmented Generation) pipelines, ensuring precision, traceability, and scalability.Collaborate with architects and ML engineers to bring LLM-based solutions into production environments.Define and apply robust evaluation frameworks and metrics for alignment, safety, hallucination control, and factual consistency.Contribute to the Hub's innovation roadmap by exploring new models, architectures, and methods for fine-tuning and instruction learning.Advise on model optimization, including quantization, distillation, and memory-efficient inference.Promote best practices in documentation, traceability, and Responsible AI across all LLM-based initiatives.Who You Are Essential Qualifications 4+ years of experience in AI model development, with at least 2 years focused on LLMs or advanced NLP systems.Provenexpertisein fine-tuning, instruction tuning, and evaluation of foundation models (GPT, Llama, Claude, Mistral, Gemma, etc.).Hands-on experience developing RAG pipelines and LLM-based reasoning architectures.Solid understanding of Python and major libraries for LLM and AI development (Transformers,LangChain,LlamaIndex, PEFT,BitsAndBytes,LoRA, Accelerate).Experience training or serving models on GPU/TPU environments (PyTorch,DeepSpeed,vLLM,Ollama).Strong background in vector databases and embedding models.Familiarity with multi-agent frameworks and orchestration systems (CrewAI,AutoGen,LangGraph, Google ADK).Knowledge of Responsible AI and evaluation principles - safety, bias mitigation, factual alignment, and model interpretability.Experience deploying models inMLOpsenvironments (MLflow, Vertex AI, Azure ML, OpenShift AI).​ Education & Certifications Bachelor's orMaster's degree in Computer Engineering, Data Science, Mathematics, Computational Linguistics, or relatedfield.Postgraduate studies (Master'sor PhD) in Natural Language Processing (NLP), Deep Learning, or Artificial Intelligence are highly valued.Additionaltraining in Generative AI, Prompt Engineering, or Responsible AI is a plus.Demonstrated commitment to continuous learning and staying current with the latest research in LLMs and generative AI.​ Preferred Skills Expertisein prompt optimization, context management, and hallucination detection/mitigation.Understanding ofLLMOpspractices and observability tools for model monitoring and evaluation.Experience with distillation, quantization, and efficient inference strategies for scaling LLMs in production.Familiarity with semantic search, retrieval frameworks, and knowledge-grounded generation.Background in reinforcement learning from human feedback (RLHF) or preference optimization.Ability to analyze research papers, prototype rapidly, and transfer innovation into production-ready systems.Comfort working with hybrid architectures, integrating models across cloud andon-premiseenvironments.Soft Skills Clear and articulate communicator, able to explain complex model behavior and design choices to diverse audiences.Analytical and experimental mindset, combining scientific rigor with creativity and problem-solving agility.Collaborative and cross-functional approach, working closely with architects, engineers, and designers to deliver cohesive AI solutions.Curiosity and innovation-driven attitude, always exploring new models, datasets, and emerging techniques in the LLM space.Business awareness, able to translate functional requirements into measurable AI outcomes.Commitment to quality and reproducibility, ensuring experiments, metrics, and models are well-documented and traceable.Adaptability and growth mindset, embracing continuous learning in the rapidly evolving world of generative AI.#AgenticAIBeing You Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.What You Can Expect With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employeelearning programsgive you access to the best learning in the industry to receive certifications,including Microsoft,Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations.At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.Get Referred If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.