Lead Ml Inference Systems Engineer
Guarda esta oferta y sigue tu búsqueda
Crea una cuenta gratis para guardar empleos, crear alertas y volver a esta oferta desde tu panel.
Al continuar, aceptas nuestros Términos & Política de Privacidad.
Runpod, the AI Developer Cloud, is seeking an ML Systems Engineer focused on inference. You will own end-to-end LLM serving performance, measure throughput and latency, and drive optimizations across models and hardware generations.
This is a hands-on role dedicated to reducing cost per token and improving reliability in production. You'll work with vLLM and SGLang, optimize for API-level latency, and collaborate with product and infra teams to craft scalable, production-grade runtimes and
#J-*-Ljbffr