Hewlett Packard Enterprise is seeking an experienced software engineer to design and implement core components of the LLM runtime, focusing on engine integration, batching, and KV cache management. You will partner with distributed teams to optimize latency, throughput, and execution across deployments.
The ideal candidate has 8+ years in software engineering with 1-2+ years in LLM inference runtimes, and strong expertise in Go, Python, Kubernetes, and deep engine internals.
#J-18808-LjbffrSenior LLM Inference Runtime Engineer in durham at Unknown Company
This position is listed as full time and onsite.