ML Inference Systems Engineer – Remote, Scalable, Low-Latency

At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll own end-to-end components from caching and batching to auto-scaling and deployment.

The role emphasizes building reliable, high-concurrency serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers to deploy open-source LLMs.