Infrastructure Ops Engineer At BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help build the platform engineers turn to to ship AI products.As an Infrastructure Ops Engineer at Baseten, you are the operational engine of our global infrastructure.
You will sit at the intersection of technical customer success and infrastructure engineering, partnering closely with our SRE and FDE teams to execute the complex hardware lifecycles that power our fleet.This role is designed for high-energy, detail-oriented individuals who thrive on technical coordination and operational excellence. You aren't just managing clusters; you are acting as the technical glue between our customers' needs and our hardware reality, ensuring that high-level capacity strategies are translated into boots-on-the-ground results.While you will be hands-on with Kubernetes and cloud-native tools, your success is measured by your ability to project-manage the resolution of capacity puzzles, ensuring our platform remains reliable, observable, and ready for the next massive AI deployment.Example InitiativesThe "Lost Node" Investigation: Debugging cluster-level blockers to solve why pods aren't scheduling despite available capacityRegional Compliance Guard: Auditing and correcting scheduling policies to ensure customer data stays within specified geographical constraintsHigh-Stakes Maintenance Orchestration: Coordinating critical maintenance cycles both externally and internally to evacuate workloads from unhealthy nodes and integrate replacement hardware with zero customer disruptionResponsibilitiesFleet Maintenance: Manage daily node operations including tainting/untainting, node draining, and PVC repairs to ensure GPU fleet health and operational cost controlGTM & Capacity Fulfillment: Partner with Sales and account teams to scope and fulfill customer capacity requests, translating complex timelines into concrete infrastructure actions and clear ETAsProcess & Observability Engineering: Identify recurring gaps in the capacity lifecycle and drive fixes by defining lightweight processes and improving system observabilityTechnical Orchestration: Act as the operational bridge between SRE and Infra teams, executing discrete changes and verifying system status during high-stakes maintenance windowsTechnical Documentation: Contribute to the internal knowledge base for GPU-specific issues to accelerate future incident resolutionAutomation & Tooling: Identify repetitive workflows and partner with engineering to build scripts, dashboards, and internal tools that reduce manual intervention and shorten time-to-mitigationKnowledge Excellence: Maintain a living database of GPU-specific intelligence and market moves to accelerate incident resolution and support strategic briefings for leadershipRequirementsBachelor's or Master's degree in Computer Science, Engineering, or a related field2+ years of professional work experience, ideally in a customer-facing technical role or as a junior SRE/Cloud EngineerStrong familiarity with Kubernetes and the lifecycle of cloud-based container orchestrationStrong ownership mindset and attention to detail, demonstrated through fast detection, clear communication, and reliable follow-throughDemonstrated ability to communicate complex technical blockers clearly to both internal engineering teams and external vendorsPreference for SF or NYC-based candidates to foster a close-knit "family" atmosphere in the officeBenefitsCompetitive compensation, including meaningful equity100% coverage of medical, dental, and vision insurance for employee and dependentsFlexible PTO policy including company wide Winter BreakPaid parental leaveFertility and family-building stipend through CarrotCompany-facilitated 401(k)Exposure to a variety of ML startups, offering unparalleled learning and networking opportunitiesApply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.At Baseten, we are committed to fostering a diverse and inclusive workplace.
We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law.