Founding Machine Learning Engineer

We are working with an early-stage AI infrastructure company in Palo Alto building the systems that will power the next generation of agentic AI.

The company is currently focused on high-performance TPU and GPU inference serving, with a broader vision to build an agent cloud for self-improving models and agents.

This is a genuinely early founding-team opportunity. You will work directly with the founders and have significant influence over both the technical architecture and the direction of the company.

The Role

You will build and optimize production infrastructure for large-scale AI workloads, with a focus on:

• High-performance TPU and GPU inference
• Distributed model serving and scheduling
• Runtime and systems optimization
• Latency, throughput and infrastructure cost
• Reliability, observability and deployment
• Infrastructure for increasingly autonomous and agentic workloads

The work sits at the intersection of ML systems, distributed systems and AI infrastructure. You could be working anywhere from low-level serving and runtime performance through to the infrastructure required for long-running, self-improving agent systems.

What They Are Looking For

You do not need experience across the entire stack, but you should have a strong background in one or more of:

• ML systems or AI infrastructure
• Model inference and serving
• Distributed training or inference
• GPU or TPU systems
• High-performance or low-latency distributed systems
• Scheduling, runtimes or compiler-level optimization

TPU experience is particularly valuable, although candidates with strong GPU infrastructure or inference backgrounds are equally relevant.

Why Join?

The company is still only a small founding team, so this is an opportunity to join before the engineering organization scales significantly.

You will have unusually high ownership, work directly alongside the founders and help define the infrastructure behind a much bigger ambition than simply building another inference platform.

The longer-term goal is infrastructure where models, agents and the systems they run on can continuously improve together with minimal human supervision.

Package

• Location: Palo Alto, in office
• Compensation: Exceptional packages, up to $500,000 cash
• Equity: Meaningful founding equity, typically around 1-2%
• Significant technical ownership from day one