LLM Inference Engineer: GPU-Optimized Serving

GMI Cloud in San Francisco is building the leading inference optimization solution and the most advanced token platform in the global token market — and we are hiring world-class Machine Learning Engineers to make GMI the new industry benchmark for LLM serving performance, cost efficiency, and production reliability.

GMI Cloud invites engineers to work on frontier research across quantization, speculative decoding, KV cache & memory management, and PD disaggregation, partnering with platform,