Senior Mlops Engineer (Training & Inference Optimization)
22 hours ago
Donostia-San Sebastian
Multiverse Computing Multiverse is a well-funded, fast-growing deep-tech company founded in 2019. We are the largest quantum software company in the EU and have been recognized by CB Insights (2023 and 2025) as one of the 100 most promising AI companies in the world. With 180+ employees and growing, our team is fully multicultural and international. We deliver hyper-efficient software for companies seeking a competitive edge through quantum computing and artificial intelligence. Our flagship products, Compactif AI and Singularity, address critical needs across various industries: Compactif AI is a groundbreaking compression tool for foundational AI models based on Tensor Networks. It enables the compression of large AI systems—such as language models—to make them significantly more efficient and portable. Singularity is a quantum- and quantum-inspired optimization platform used by blue-chip companies to solve complex problems in finance, energy, manufacturing, and beyond. It integrates seamlessly with existing systems and delivers immediate performance gains on classical and quantum hardware. You’ll be working alongside world‑leading experts to develop solutions that tackle real‑world challenges. We’re looking for passionate individuals eager to grow in an ethics‑driven environment that values sustainability and diversity. We’re committed to building a truly inclusive culture—come and join us. About the Role We are seeking a Senior MLOps Engineer to steer the technical vision of our Training and Inference Optimization team. In this high‑impact role, you will architect the infrastructure that powers our next‑generation AI models. You will bridge the gap between systems programming and machine learning, optimizing large‑scale LLM training via NVIDIA Ne Mo and building ultra‑high‑throughput serving systems using v LLM, Tensor RT-LLM, and SGLang. Your mission is to ensure our models are not only state‑of‑the‑art but also production‑hardened, cost‑efficient, and performant at scale. Key Responsibilities Training Infrastructure: Architect and maintain scalable distributed training pipelines using NVIDIA Ne Mo/Nemotron/Megatron‑Bridge. You will optimise GPU utilisation, manage complex checkpointing strategies, and implement automated fault tolerance for long‑running jobs. Inference Orchestration: Lead the deployment of LLMs using v LLM, Tensor RT‑LLM, or SGLang. You will implement and tune cutting‑edge techniques—including Paged Attention, continuous batching, and advanced quantisation (AWQ/FP8 )—to maximise throughput and minimise TPOT (Time Per Output Token). Workload Orchestration: Utilize SLURM/Flyte/Ray/Sky Pilot to manage and scale ML workloads across diverse cloud providers and on‑prem clusters, ensuring seamless resource shifting and cost‑effective execution. Lifecycle Management: Standardise model tracking, versioning, and transition workflows using MLflow (or similar tool), ensuring reproducible training runs and a clear path from research to production. Performance Engineering: Conduct deep‑dive profiling and bottleneck analysis across the full stack—from CUDA kernels and NCCL collective communications to Python‑level orchestration. Efficiency & Cost Governance: Monitor and optimise cloud and on‑prem GPU expenditures through intelligent scaling policies and high‑density resource packing. Technical Leadership: Set the bar for engineering excellence. You will drive the roadmap, perform rigorous code reviews, and mentor junior and mid‑level engineers. Required Qualifications Experience: 5+ years in MLOps, Dev Ops, or Software Engineering, with a minimum of 2 years dedicated to LLM infrastructure. Deep Learning Ecosystem: Expert‑level proficiency with Py Torch and the NVIDIA stack (CUDA, NCCL, Triton ). Specialised Tooling: Hands‑on experience with NVIDIA Ne Mo (or Megatron‑Bridge) for distributed training and at least two of the following for serving: v LLM, Tensor RT‑LLM, or SGLang. Orchestration & Lifecycle: Proven experience with SLURM/Flyte/Ray/Sky Pilot for cluster management and MLflow (or similar tool) for experiment and model management. Infrastructure: Deep expertise in Kubernetes and K8s operators (e.G., Kube Ray, MPI Operator, or Run:ai ). Systems Programming: Mastery of Python and a functional understanding of C++ or Rust for performance‑critical components. Next‑Gen Hardware: Familiarity with high‑performance networking (Infini Band/Ro CE ) and NVIDIA H200/B200 (Blackwell) architectures. Preferred Skills Active contributions to relevant open‑source projects (v LLM, SGLang, Sky Pilot, or Ne Mo ). Proven track record with model compression (Sparsity, Distillation, or Quantisation). Experience writing or optimising custom Triton kernels. Expertise in ML observability stacks (Prometheus, Grafana, Jaeger). Perks & Benefits Indefinite contract Equal pay guaranteed. Variable performance bonus. Signing bonus. We offer work visa sponsorship (If applicable). Relocation package (if applicable). Private health insurance. Eligibility for educational budget according to internal policy. Hybrid opportunity. Flexible working hours. Language classes and discounted lunch options. Working in a high paced environment, working on cutting edge technologies. Career plan. Opportunity to learn and teach. As an equal opportunity employer, Multiverse Computing is committed to building an inclusive workplace. The company welcomes people from all different backgrounds, including age, citizenship, ethnic and racial origins, gender identities, individuals with disabilities, marital status, religions and ideologies, and sexual orientations to apply. #J-18808-Ljbffr
Waiters
Sales & Marketing
Chef & Cook
Retail
Salon & Beauty
Construction & Trades
Quick Service
Accounting & Finance
Animal Care
Art, Media, Design
Bar Staff
Child Care
Cleaning
Customer Service
Driver & Delivery
Education
Engineering
Entertainment
Events & Promotion
Fashion
Health & Social Care
Host & Hostess
Information Technology
Kitchen Porter
Legal
Management
Manufacturing
Office & Admin
Science
Security
Sports & Wellness
Warehouse
Writing & Editing
Other
