Application Production

Role: Application Production Support Engineer

Location: Charlotte, NC (Hybrid role – 3 days/week)

Exp : 8+ Years

Job Description

Experienced Application Production Support Engineer with 1-2 years of experience supporting AI/LLM-driven applications in production environments. The ideal candidate should have hands-on experience in production support, incident management, monitoring, troubleshooting, and operational support for applications leveraging Generative AI and Large Language Models (LLMs).

Key Responsibilities:

· Provide L2/L3 production support for applications utilizing Large Language Models (LLMs) and Generative AI technologies.

· Monitor application health, performance, and availability using observability tools such as Splunk and Dynatrace.

· Troubleshoot production issues related to AI applications, APIs, backend services, infrastructure, and databases.

· Investigate and resolve incidents within SLA timelines, perform root cause analysis (RCA), and implement preventive measures.

· Support and maintain Redis and MongoDB databases, ensuring optimal performance and availability.

· Monitor LLM consumption metrics including Token Usage, Tokens Per Minute (TPM), Requests Per Minute (RPM), throttling limits, and rate limits.

· Collaborate with development, infrastructure, cloud, and AI engineering teams to resolve complex production issues.

· Support containerized workloads deployed on Kubernetes and/or OpenShift platforms.

· Utilize LLM observability and evaluation platforms such as LangSmith, Galileo, or similar tools to analyze model behavior and performance.

· Participate in production deployments, release activities, and change management processes.

· Maintain operational runbooks, troubleshooting guides, and knowledge-base documentation.