Staff Software Engineer, ML Training And Inference InfrastructureRivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we constantly challenge what's possible, never simply accepting what has always been done.
We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.Role Summary: As a Staff Software Engineer, ML training and inference infrastructure, you will be a member of the Perception team at Rivian, which develops advanced machine learning algorithms that directly impact safety critical self-driving features of our category defining vehicles. We are looking for candidates with deep knowledge and strong enthusiasm towards establishing a state-of-art ML infrastructure for training and inference of large autonomous driving models; and optimizing the training and inference performance.Responsibilities:Optimize the performance of Deep Learning training workload on NVIDIA GPU systems on a large scaleOptimize the latency of model inference and model pre- and post-processing on onboard systemsDesign, train, and deploy large deep learning models that can leverage the vast amount of labeled and unlabeled dataQualifications:PhD in CS/CE/EE, or equivalent, in industry experienceDeep knowledge of PyTorchKnowledge of model training framework (e.g.
PyTorch Lightning, ray, etc.)In-depth knowledge of transformer architecture and ways to accelerate the training and inference of transformer modelsExperience of performing large scale distributed training of modelsA track record of profiling models and doing detective work to improve model training and inference speedPreferred Skill Requirements:Experience with CUDA or Triton language for writing custom opsKnowledge of Nvidia TensorRTKnowledge of NCCLExperience with edge computing systemsA track record of efficiently solving complex problems collaboratively on larger teamsPay Disclosure: Salary Range for California Based Applicants: $228,000.00 - $285,000.00 (actual compensation will be determined based on experience, location, and other factors permitted by law).Benefits Summary: Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of employment