Senior ML engineer optimizing LLM inference engines for production deployment.
Lead optimization initiatives for large language model serving infrastructure, focusing on latency, throughput, and cost-per-token improvements across inference engines and distributed systems. You will collaborate with kernel and platform engineers to implement advanced techniques such as quantization, speculative decoding, and multi-node GPU execution, while building and validating reproducible benchmarks under real-world workloads. The role requires deep expertise in transformer inference bottlenecks, distributed system design, and hands-on experience with modern serving frameworks.
Membership is €29/month, cancel anytime: every rate, every original listing link, and a daily alert for roles matching your filters.
Found at a specialist agency · listed 7 October 2026 · InsideJobs links you to the original posting.