Salad Technologies is seeking a Staff Software Engineer to own the AI Inference Gateway. This fully remote, full-time role centers on real-time and batch inference across GPU fleets, using Rust, Pingora, and WireGuard to deliver a reliable API.
You will design routing, scaling, and billing logic, benchmark models and quantizations, and ensure observability across the gateway. Collaboration with senior engineers and product managers is expected for production-ready decisions.
#J-18808-LjbffrStaff AI Inference Gateway Engineer Remote in workfromhome at Unknown Company
This position is listed as full time and able to be worked remotely.