Senior Deployment EngineerSenior Deployment Engineer (RAG / LLM Systems) Company: BHO Tech Location: Bay Area (Hybrid) Compensation: $170K-$240K + bonus + equity (DOE)About BHO Tech BHO Tech partners with high-growth AI startups to build world-class engineering teams. Our clients move fast and value engineers who take ownership and ship.Role We are looking for a Senior Deployment Engineer to deploy, maintain, and scale RAG pipelines and LLM-powered applications in production. You'll ensure models, embeddings, vector databases, and backend systems run reliably, efficiently, and securely.What You'll DoDeploy and operate RAG pipelines and LLM-based services in productionManage vector databases (Pinecone / Weaviate / Chroma / Milvus)Optimize latency, throughput, and memory footprintWork closely with ML + Backend teams to push new features liveCreate deployment tooling, rollout strategies, and fallback systemsMonitor performance, debug production issues, automate reliability workflowsWhat We're Looking ForStrong experience deploying Python-based services or microservicesFamiliar with LLM pipelines, embeddings, or data retrieval flowsHands-on with AWS / GCP and containerization (Docker / Kubernetes)Solid understanding of CI/CD pipelines and environment automationAbility to move fast, communicate clearly, and own deployments end-to-endBonus: Experience with GPU scheduling / Triton / inference optimizationBackground in SRE, DevOps, or Production EngineeringPrior startup / 0?1 product experienceInterested?
Send your résumé to and I will forward you the full details. Best regards, Kris Young Director | BHO Tech Inc.
Senior Deployment Engineer in san francisco at Unknown Company
This position is listed as full time and hybrid.