Sr Staff Engineer

Sr. Staff EngineerWe are looking for a Sr. Staff Engineer to join our team.Key ResponsibilitiesDesign and architect enterprise-wide Generative AI solutions, including reference architectures, integration patterns, and technical standards.Design, build, and maintain an enterprise AI gateway to centralize access, governance, and monitoring of AI model consumption across the organization.Develop and implement intelligent routing techniques to direct requests across multiple large language models (LLMs) and AI providers based on cost, latency, accuracy, and availability requirements.Evaluate and integrate local/on-premises models as alternatives to third-party hosted models, with a focus on reducing operational costs.Establish frameworks for measuring and demonstrating cost savings achieved through model selection, routing optimization, and infrastructure decisions.Collaborate with engineering, security, and compliance stakeholders to ensure AI architecture adheres to organizational governance and regulatory requirements.Define best practices for prompt orchestration, caching strategies, and fallback mechanisms within the AI gateway.Provide technical leadership and mentorship to engineering teams adopting Generative AI capabilities.Provide mentorship and lead a team of AI/ML engineers.Required QualificationsDemonstrated experience architecting Generative AI solutions at an enterprise scale.Research and integrate cutting-edge LLMs and autonomous AI agent architecture into development processesDevelop RAG pipelines that enhance AI's ability to retrieve relevant knowledge and generate context-aware responses.Build and optimize agentic AI systems that can interact with APIs, databases, and development environments (such as LangChain, OpenAI APIs, etc.)Fine-tune LLMs (GPT, Llama, Mistral, Claude, Gemini etc.) for domain-specific applications.Optimize models for local inference through quantization, pruning, and distillation.Deploy models on-prem or at the edge using frameworks such as PyTorch, TensorRT, ONNX, vLLM, or llama.cpp.Build and maintain training and inference pipelines for reproducibility and scalability.Integrate locally deployed models into production systems via APIs and internal services.Monitor model performance, drift, latency, and resource utilization in productionOptimize retrieval mechanisms to enhance response accuracy, grounding AI outputs in real-world dataHands-on experience designing and implementing AI gateway solutions and model routing techniques.Proven track record of achieving measurable cost savings through the use of local/open-source models or alternative optimization techniques.Strong understanding of LLM provider ecosystems, API integration patterns, and multi-model orchestration.Experience with cloud infrastructure and enterprise architecture frameworks.Solid grasp of AI governance, security, and compliance considerations in enterprise environments.Excellent communication skills, with the ability to present technical concepts to both technical and non-technical stakeholders.Architect and deploy scalable AI models and retrieval pipelines using cloud-based MLOps pipelines (AWS/GCP/Azure, Docker, Kubernetes)Optimize LLMs for real-time AI inferencing, ensuring low latency and high-performance AI solutionsEducation: Master's or Ph.D.

in Computer Science, AI, Machine Learning, or a related field.Experience: 5+ years of experience in AI and machine learning, with at least 2 years of experience working on LLMs, code generation, RAG, or AI-powered automationPay & BenefitsConsistent with Lattice Semiconductor values and applicable law, we provide the following information to promote pay transparency and equity. We have a market-based pay structure which varies by location. Please note that the base pay range is a guideline, and our compensation range reflects the cost of labor in the U.S.

geographic market based on the location of the role. Pay within these ranges varies and depends on job-related knowledge, skills, and relevant work experience.For candidates who receive and offer, the starting salary will vary based on various factors including, but not limited to, such qualifications as, skill level, competencies, and work location. The range provided may represent a candidate range and may not reflect the full range for an individual tenured employee.Base Pay Range In addition to base pay, this role may be eligible for variable/ incentive compensation and/ or equity.

In addition, this role is eligible for a comprehensive, competitive benefits package which may include healthcare and retirement plans, paid time off, and more!Additional Information:This position requires a successful background and reference checks and satisfactory proof of your right to work in the United States.Lattice recognizes that employees are its greatest asset and the driving force behind success in a highly competitive, global industry. Lattice continually strives to provide a comprehensive compensation and benefits program to attract, retain, motivate, reward and celebrate the highest caliber employees in the industry.