Senior Infrastructure EngineerWe're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.Who You AreDeep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflowsDeep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimizationStrong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementationExperience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpointsProficiency with API design and cloud-init for automated provisioning and configurationSolid understanding of GPU architecture, CUDA, and GPU compute optimizationHighly collaborative team player with excellent communication skills across technical and non-technical stakeholdersProven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrationsExperience building and scaling cloud infrastructure or distributed systems in production environmentsPreferred QualificationsFamiliarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)Experience with distributed storage systems such as Ceph, Weka, or VAST DataHyperbolic is an equal opportunity employer.
We celebrate diversity and are committed to creating an inclusive environment for all employees.