Senior AI Product Engineer II

Senior AI Product Engineer II

Overview

A high-growth software company is seeking a Senior AI Product Engineer to develop and deliver AI-powered product experiences. This role focuses on building customer-facing features that leverage large language models (LLMs), retrieval systems, and agent-based workflows to improve user productivity and decision-making. You will work closely with AI specialists, product managers, and designers to transform AI capabilities into polished product experiences. The ideal candidate combines strong full-stack engineering expertise with practical AI development experience and excellent product instincts.

Key Responsibilities

• Design, build, and maintain AI-powered product features across the full stack using modern web technologies.
• Develop responsive user interfaces that support streaming responses, real-time interactions, and progressive AI-generated content.
• Create backend services and APIs that integrate with AI models, orchestration frameworks, and supporting services.
• Translate retrieval-based systems, autonomous workflows, and structured reasoning outputs into intuitive user experiences.
• Collaborate with AI engineers to define interfaces, output schemas, and integration patterns.
• Evaluate how AI-generated content performs in real-world usage and improve product experiences accordingly.
• Build feedback mechanisms that capture user sentiment and AI output quality.
• Establish observability and monitoring for AI features, including latency, adoption, engagement, and task completion metrics.
• Implement automated testing strategies covering integration and end-to-end AI workflows.
• Develop reusable components, patterns, and frameworks that accelerate future AI product development.
• Mentor engineers and contribute to technical and product design discussions.

Required Qualifications

• 7+ years of professional software engineering experience building and shipping production applications.
• 2+ years of experience developing AI-enabled product features.
• Strong expertise in React and TypeScript.
• Experience building highly interactive web applications that handle asynchronous and real-time data.
• Solid backend development experience with Python, Node.js, and TypeScript.
• Experience designing and consuming APIs that integrate with AI services.
• Hands-on experience with LLM-based applications and prompt design techniques.
• Practical understanding of:
  • Context management
  • Retrieval-Augmented Generation (RAG)
  • Structured outputs
  • AI evaluation and quality measurement frameworks
• Familiarity with agent orchestration frameworks and multi-step AI workflows.
• Experience implementing streaming patterns such as Server-Sent Events (SSE), WebSockets, or similar real-time communication methods.
• Strong product mindset with a focus on user experience and adoption.
• Proven ability to work effectively with cross-functional teams in fast-paced environments.

Preferred Qualifications

• Experience in regulated, compliance-oriented, security-focused, governance, risk, or document-intensive business environments.
• Familiarity with Model Context Protocol (MCP) or comparable tool-integration approaches.
• Experience troubleshooting retrieval quality and search relevance issues within AI applications.
• Experience building annotation, review, or feedback tooling for AI systems.

Work Model / Location / Engagement Details

• Hybrid work environment with a combination of in-office collaboration and flexible remote work days.
• Full-time position.
• Compensation range: $192,000 - $259,800 base salary , plus equity and benefits.

Benefits Highlights

• Equity participation.
• Comprehensive medical, dental, and vision coverage.
• Retirement savings program and financial wellness benefits.
• Life and disability insurance.
• Paid parental leave and family-building support programs.
• Professional development and learning stipends.
• Flexible paid time off and company holidays.