Memory-Optimized LLM Inference Engineer

Acceler8 Talent seeks a Member of Technical Staff, ML Systems for an early-stage AI infrastructure company focused on creating a memory layer for large-scale inference. The role centers on building low-level ML systems and optimizing performance across GPUs and accelerators.

You will work on long-context inference, KV-cache management, and reducing the cost of keeping model state close to compute, while contributing to hardware/software co-design and system-level integration with inference