Senior Software Engineer, Machine Learning SystemsLocation: San JoseTeam: TechnologyEmployment Type: RegularJob Code: A ResponsibilitiesDesign, develop, and optimize machine learning systems, focusing on heterogeneous computing architectures, resources management, and system monitoring. Deploy and maintain scalable ML infrastructure, including distributed task scheduling and large-scale training pipelines. Facilitate cross-layer optimization across hardware, systems, and AI algorithms to improve performance and efficiency of ML workloads.
Implement and enhance training framework features, supporting general-purpose functionality and model-specific optimizations, including large language models and diffusion models. Improve reliability, efficiency, and throughput of massive-scale distributed training jobs across diverse computing environments. Mentor interns and junior engineers.QualificationsMust have a Master's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Systems, Data Science, Mathematics, or a related field, and 2 years of related work experience; OR a Bachelor's degree or foreign equivalent degree in Computer Science, Engineering (any), Information Systems, Data Science, Mathematics, or a related field, and 5 years of post-bachelor's, progressive related work experience.
Of the required experience, must have 2 years of experience in each of the following: Designing and implementing software service architecture to support high throughput and fault tolerant services; Working with computing systems utilizing GPU or ASIC for machine learning applications; Developing machine learning models using platforms and frameworks, including PyTorch or JAX; Designing and managing databases to support online services using MySQL or Redis; and Programming in a Linux environment using C/C++, CUDA, or Python.