Amazon is seeking a Senior Software Development Engineer to design and implement inference data plane software for large models on custom hardware. You will own end-to-end features from kernel development to deployment, enable efficient data movement, and drive performance across the stack.
You will work on a ground-up effort with rapidly evolving hardware and software, contributing to model validation, profiling infrastructure, and integration with serving frameworks like vLLM and PyTorch.
#J-18808-LjbffrSenior ML Systems Engineer - Inference & Custom Hardware in northern at Unknown Company
This position is listed as full time and onsite.