NVIDIA AI is seeking a Senior Software Engineer to contribute features and optimizations to upstream inference engines and enhance runtime capabilities for high-throughput, low-latency inference. You will profile and improve performance across layers and collaborate with teams to translate production requirements into effective solutions.
The role requires 5+ years of production software experience with a focus on performance and reliability, and strong skills in Python, C++/CUDA, and LLM
#J-18808-LjbffrSenior Software Engineer, LLM Inference & Performance in town of santa clara at Unknown Company
This position is listed as full time and onsite.