Senior MLOps Engineer (Training & Inference Optimization) | Relocation Offered
6 days ago
San Sebastián
ppSenior MLOps Engineer (Training Inference Optimization) /p pSan Sebastian, Spain /p pMultiverse Computing /p ul liAdvanced relocation package /li liLanguage courses /li liVisa services /li liSigning bonus /li liRelocation bonus /li /ul pMultiverse is a well‑funded, fast‑growing deep‑tech company founded in 2019. We are the largest quantum software company in the EU and have been recognized by CB Insights (2023 and 2025) as one of the 100 most promising AI companies in the world. /p pWith 180+ employees and growing, our team is fully multicultural and international. We deliver hyper‑efficient software for companies seeking a competitive edge through quantum computing and artificial intelligence. /p pOur flagship products, CompactifAI and Singularity, address critical needs across various industries: /p ul liCompactifAI is a groundbreaking compression tool for foundational AI models based on Tensor Networks. It enables the compression of large AI systems—such as language models—to make them significantly more efficient and portable. /li liSingularity is a quantum‑and quantum‑inspired optimization platform used by blue‑chip companies to solve complex problems in finance, energy, manufacturing, and beyond. It integrates seamlessly with existing systems and delivers immediate performance gains on classical and quantum hardware. /li /ul pYou’ll be working alongside world‑leading experts to develop solutions that tackle real‑world challenges. We’re looking for passionate individuals eager to grow in an ethics‑driven environment that values sustainability and diversity. /p pWe’re committed to building a truly inclusive culture—come and join us. /p h3Position /h3 pWe are seeking a bSenior MLOps Engineer /b to steer the technical vision of our Training and Inference Optimization team. In this high‑impact role, you will architect the infrastructure that powers our next‑generation AI models. You will bridge the gap between systems programming and machine learning, optimizing large‑scale LLM training via bNVIDIA NeMo /b and building ultra‑high‑throughput serving systems using bvLLM /b, bTensorRT-LLM /b, and bSGLang /b. /p pYour mission is to ensure our models are not only state‑of‑the‑art but also production‑hardened, cost‑efficient, and performant at scale. /p h3Key Responsibilities /h3 ul liTraining Infrastructure: Architect and maintain scalable distributed training pipelines using NVIDIA NeMo/Nemotron/Megatron‑Bridge. You will optimize GPU utilization, manage complex checkpointing strategies, and implement automated fault tolerance for long‑running jobs. /li liInference Orchestration: Lead the deployment of LLMs using vLLM, TensorRT-LLM, or SGLang. You will implement and tune cutting‑edge techniques—including PagedAttention, continuous batching, and advanced quantization (AWQ/FP8) to maximize throughput and minimize TPOT (Time Per Output Token). /li liWorkload Orchestration: Utilize SLURM/Flyte/Ray/SkyPilot to manage and scale ML workloads across diverse cloud providers and on‑prem clusters, ensuring seamless resource shifting and cost‑effective execution. /li liLifecycle Management: Standardize model tracking, versioning, and transition workflows using MLflow (or similar tool), ensuring reproducible training runs and a clear path from research to production. /li liPerformance Engineering: Conduct deep‑drive profiling and bottleneck analysis across the full stack — from CUDA kernels and NCCL collective communications to Python‑level orchestration. /li liEfficiency Cost Governance: Monitor and optimize cloud and on‑prem GPU expenditures through intelligent scaling policies and high‑density resource packing. /li liTechnical Leadership: Set the bar for engineering excellence. You will drive the roadmap, perform rigorous code reviews, and mentor junior and mid‑level engineers. /li /ul h3Qualifications /h3 ul liExperience: 5+ years in MLOps, DevOps, or Software Engineering, with a minimum of 2 years dedicated to LLM infrastructure. /li liDeep Learning Ecosystem: Expert‑level proficiency with PyTorch and the NVIDIA stack (CUDA, NCCL, Triton). /li liSpecialized Tooling: Hands‑on experience with NVIDIA NeMo (or Megatron‑Bridge) for distributed training and at least two of the following for serving: vLLM, TensorRT‑LLM, or SGLang. /li liOrchestration Lifecycle: Proven experience with SLURM/Flyte/Ray/SkyPilot for cluster management and MLflow (or similar tool) for experiment and model management. /li liInfrastructure: Deep expertise in Kubernetes and K8s operators (e.g., KubeRay, MPI Operator, or Run:ai). /li liSystems Programming: Mastery of Python and a functional understanding of C++ or Rust for performance‑critical components. /li liNext‑Gen Hardware: Familiarity with high‑performance networking (InfiniBand/RoCE) and NVIDIA H200/B200 (Blackwell) architectures. /li /ul h3Nice to Have /h3 ul liActive contributions to relevant open‑source projects (vLLM, SGLang, SkyPilot, or NeMo). /li liProven track record with model compression (Sparsity, Distillation, or Quantization). /li liExperience writing or optimizing custom Triton kernels. /li liExpertise in ML observability stacks (Prometheus, Grafana, Jaeger). /li /ul h3Additional Details /h3 pAs an equal opportunity employer, Multiverse Computing is committed to building an inclusive workplace. The company welcomes people from all different backgrounds, including age, citizenship, ethnic and racial origins, gender identities, individuals with disabilities, marital status, religions and ideologies, and sexual orientations to apply. /p /p #J-18808-Ljbffr
