This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager – AI Product based in Germany.
Join an opportunity to lead the development of a cutting-edge AI platform that powers innovative products at scale. This role combines technical leadership with hands-on engineering, offering the chance to shape architecture, mentor a talented team, and contribute directly to production-grade AI systems. Working in a collaborative, remote-first environment, you will drive the evolution of modern AI infrastructure while balancing strategic decision-making with active software development. If you enjoy building high-performance AI platforms, leading by example, and delivering meaningful impact in a fast-paced setting, this role offers an exciting next step in your career.
Accountabilities
- Lead, mentor, and develop a small team of AI engineers, fostering a culture of ownership, collaboration, and engineering excellence.
- Define the technical vision and architectural direction of the AI product, ensuring high standards for performance, scalability, reliability, and cost efficiency.
- Contribute hands-on to the design, implementation, and optimization of production AI systems, including model serving, inference pipelines, retrieval systems, orchestration, and evaluation frameworks.
- Oversee the end-to-end AI platform, including GPU infrastructure, model deployment, versioning, embedding pipelines, monitoring, and quality evaluation processes.
- Collaborate closely with Product, Infrastructure, Security, and Backend teams to align priorities, deliver integrated solutions, and support strategic business goals.
- Conduct regular performance reviews, coaching sessions, and technical mentoring while translating long-term objectives into clear execution plans and ensuring successful project delivery.
Requirements
- 7+ years of experience in software engineering, including at least 2 years in an engineering management or technical leadership role.
- Proven experience building and operating production AI/ML platforms or inference infrastructure, with expertise in model serving, GPU workloads, latency optimization, and cost management.
- Strong backend engineering skills, including Python proficiency and experience with distributed systems; knowledge of Go, Rust, or similar languages is considered an advantage.
- Hands-on experience with modern LLM technologies, including model APIs, open-weight models, serving frameworks, vector databases, retrieval systems, and prompt or context engineering.
- Solid understanding of AI quality evaluation, benchmarking, observability, regression testing, and monitoring for non-deterministic systems.
- Experience with cloud environments, preferably AWS, along with Kubernetes, containerization, Infrastructure-as-Code tools, CI/CD pipelines, Linux systems, networking fundamentals, and monitoring solutions.
- Excellent communication, leadership, and decision-making skills, with the ability to balance strategic planning, technical execution, and people management.
Benefits
- Fully remote position with collaboration across the European time zone.
- Opportunity to lead a highly impactful AI product with significant ownership and technical influence.
- Hands-on leadership role combining engineering management with active software development.
- Exposure to cutting-edge AI technologies, including LLMs, inference infrastructure, GPU computing, and distributed systems.
- Close collaboration with cross-functional engineering, infrastructure, product, and security teams.
- Career growth through technical leadership, architecture ownership, and strategic decision-making.