Staff Technical Product Manager – AI Infrastructure & Agent Platforms
Location: New York City | 5 days onsite
Salary: $180,000–$250,000 (subject to confirmation)
Company: Confidential | AI-native technology business
We're partnering with an ambitious AI technology business in New York that is building intelligent agents to automate complex enterprise workflows. We have just placed a Product Manager within this organisation last week so are very excited to partner with them again on this role.
Following progress on their first Product Manager hire, they're expanding the team again. This time, the focus is on a more technically oriented Product Manager who understands the infrastructure, backend systems and platforms required to build reliable AI agents at scale.
This is not a traditional customer-facing or commercially focused PM role. We're looking for someone who can work closely with engineers and AI specialists to build the foundations that make agentic AI systems reliable, measurable and production-ready.
What you'll be doing
- Own the roadmap for AI infrastructure, backend services and agent platform capabilities.
- Work closely with engineering teams on agent orchestration, tool calling, APIs and system integrations.
- Help develop evaluation frameworks to measure agent quality, reliability and performance.
- Define requirements for observability, tracing, monitoring and debugging of AI workflows.
- Support the development of scalable infrastructure for LLM-powered applications.
- Translate complex technical challenges into clear product priorities and deliverables.
- Make informed trade-offs across performance, latency, reliability, security and cost.
- Help establish the technical foundations for deploying and improving AI agents in production.
What we're looking for
- Strong technical Product Management experience within AI infrastructure, developer platforms, backend systems or ML platforms.
- Practical understanding of LLMs, AI agents and agentic workflows.
- Experience with AI evaluations, testing, monitoring or model performance measurement.
- Confidence discussing APIs, distributed systems, data pipelines and platform architecture with engineers.
- Experience taking complex technical products from development into production.
- A hands-on approach suited to a small, fast-moving engineering team.
- Ideally, experience within an AI-native business, developer tools company or established technical product organisation.
Particularly relevant experience: LLM evaluation systems, MLflow, LangGraph, RAG infrastructure, agent orchestration, model observability, developer tooling, inference infrastructure and AI platform engineering.
This is an opportunity to work on the technical foundations of production AI agents within a small team backed by an established enterprise technology business.
Interested? Send me a message or share your CV for a confidential conversation.
Staff Product Manager in brooklyn at Unknown Company
This position is listed as full time and onsite.