Senior Lead AI Engineer (FM Hosting, LLM Inference)

BluePeak Digital Solutions

Medical Insurance

Contractor | On-site

Job Description

The Senior Lead AI Engineer specializes in hosting foundation models (FMs), optimizing large language model (LLM) inference, and building scalable AI infrastructure. This role leads the deployment, monitoring, and performance tuning of AI systems used in production environments.

Key Responsibilities

• Lead the deployment and hosting of foundation models and LLMs.
• Optimize inference pipelines for latency, throughput, and cost efficiency.
• Design scalable AI infrastructure using cloud, containerization, and orchestration technologies.
• Collaborate with AI researchers, data scientists, and platform engineers.
• Implement monitoring, security, and reliability practices for AI services.

Education Requirements

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
• Ph.D. preferred for candidates with advanced AI research or large-scale model deployment experience.

Preferred Skills

• Experience with LLMs, foundation models, and AI inference frameworks.
• Proficiency in Python, PyTorch, TensorFlow, CUDA, and GPU optimization.
• Knowledge of Kubernetes, Docker, AWS/GCP/Azure, and distributed systems.
• Strong leadership and cross-functional collaboration skills.

New York, New York, United States, New York, New York, United States