Platform Team Lead

About Zyte At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data.Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. Today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.Overview We are seeking an experienced Team Lead to manage our Core & MLOps Squad, responsible for "Building the bedrock infrastructure that powers Zyte at scale." This hands-on technical leadership role requires expertise across MLOps, systems programming, and orchestration to lead a cross-functional team in designing and maintaining the scalable foundation that enables all Zyte teams to build and run their services with confidence.What you'll do Design and evolve the core platform (Kubernetes, Mesos, GPU scheduling/autoscaling, distributed compute)Own the model platform: registry, experiment tracking, training orchestration, evaluation, serving, and monitoringBuild the Golden Path: reference repos, a scaffold CLI, opinionated CI/CD pipelines, runtime contracts (health/metrics/tracing/SLOs), high-performance clients, circuit breakers and other production‑ready defaultsMLOps Excellence Operate a secure, multi‑tenant model registry and training platform with standardized experiment/evaluation harnessesProvide turnkey serving patterns (online + batch), drift/quality monitoring, and rollback playbooksIntegrate public/open‑source AI capabilities as managed platform services with cost and data‑governance guardrailsTeam Management Run the squad: roadmap/prioritization, delivery, mentoring, and high engineering standardsPartner with product engineering (Zyte API, Scrapy Cloud), Prod Ops, and Security on adoption and rollout plansMentor the team and foster a platform-thinking mindsetOwnership Areas Container orchestration (Kubernetes/Knative), GPU provisioning & autoscaling, environment & secret managementOperators, sidecars, and internal SDKs/libraries (Go/Rust/Python/Java) that enforce the golden path contractModel platform: registry, experiment tracking, training orchestration, evaluation framework, serving infra, model monitoringObservability: logging/metrics/tracing pipelinesBilling pipeline: metering/events/cost tracking abstractionsGolden Path: Java, Python, ML templates + CI/CD blueprints + docs + scaffold CLIReliability enablement (SRE practices), cost governance, supply‑chain security (SBOM, image signing)Qualifications Required 5+ years experience building distributed systems; 3+ years in MLOps/ML platform engineering (or equivalent impact)Knowledge of Linux/OS internals (process model, cgroups/namespaces), networking (TCP/IP, HTTP/2), concurrency, and performance profilingDeep understanding of Kubernetes (bonus: Mesos)Proficiency developing high-performance services in Java, Rust, Go or C++ (bonus: familiarity with vert.x and Netty frameworks); strong Python skillsExperience with GPU infrastructure (scheduling, containerization, optimization)Track record of designing and operating model platforms (registry, training, serving, monitoring) in productionDemonstrated success leading technical teams and implementing organization-wide platform solutionsPreferred Streaming & workflows: Kafka plus Argo/Temporal/Airflow or equivalentseBPF‑based observability, perf tooling, or io_uring experienceCost optimization for ML/AI; multi‑tenant quotas and fairnessHands‑on experience authoring Golden Paths (service chassis/templates, CI/CD blueprints, CLI scaffolds)SRE practices (SLIs/SLOs, incident management)Benefits We love fostering and nourishing new ideas and bringing them to marketBecome part of a self-motivated, progressive, multi-cultural teamHave the freedom and flexibility to work from where you do your best work, as we are a completely remote companyGet the chance to work with cutting-edge open-source technologies and toolsSeniorities Seniority level: Mid-Senior levelEmployment type: Full-timeJob function: Information TechnologyIndustries: IT Services and IT ConsultingReferrals increase your chances of interviewing at Zyte by 2xGet notified about new Team Lead jobs in Barcelona, Catalonia, Spain .#J-18808-Ljbffr