The Senior Software Engineer will contribute features and optimizations to upstream inference engines and improve runtime capabilities for high-throughput, low-latency inference. They will also profile and enhance performance across various layers and collaborate with teams to translate production requirements into effective solutions.
Requirements:
Candidates should have over 5 years of experience in building production software with a focus on performance and reliability improvements. Strong programming skills in Python and C++/CUDA, along with experience in LLM inference stacks and profiling, are essential.
Key Skills:
Python, C++, CUDA, Performance Optimization, Distributed Systems, Concurrency, Profiling, Benchmarking, Open-source Contributions, LLM Inference, Systems Engineering, Data Analysis, Resource Utilization, Collaboration, Debugging
Benefits:
- Equity
- Health Insurance
Senior Software Engineer - AI Inference in town of santa clara at Unknown Company
This position is listed as full time and onsite.