Develop and evolve a state-of-the-art inference framework in modern C++ that extends TensorRT with autoregressive model serving capabilities. Collaborate with teams across CUDA, kernel libraries, compilers, and robotics to deliver high-performance, production-ready solutions.
Requirements
Candidates should have a BS, MS, PhD, or equivalent experience in a relevant field and at least 4 years of software development experience. A deep understanding of transformer models and proficiency in modern C++ are essential.
Key Skills
C++, TensorRT, LLM, VLM, GEMM, CUDA, Attention, MoE, KV Cache Management, Speculative Decoding, Quantization, Tensor Parallelism, Memory-Efficient Scheduling, Compiler Infrastructure, Robotics, Embedded AI
Benefits
Equity, Health Insurance
#J-18808-LjbffrSenior Software Engineer – TensorRT Edge-LLM in santa clara at Unknown Company
This position is listed as full time and onsite.