Senior Software Engineer
Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. Your role involves ensuring access to high-quality large language models (LLMs) for users throughout the inference software stack.
Responsibilities
- Lead the evaluation, configuration, and deployment of inference models for our users.
- Mentor engineers and establish development best practices and standards.
- Collaborate with other teams to integrate LLM-powered tools and build solid infrastructure.
- Support short-term, high-priority needs from our customer.
Required Skills
- Experience with Python and/or modern programming languages.
- Knowledge of Argo CD or other CI/CD frameworks.
- Familiarity with Kubernetes/Helm.
- Experience with AWS or another cloud service provider.
- Strong communication skills and the ability to mentor engineers.
Nice To Have
- Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
- Familiarity with Site Reliability Engineering (SRE) best practices.
- Knowledge of observability frameworks like Elastic, Grafana/Prometheus.
Experience Required
12 years with Bachelor's degree in a technical field, or 16 years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $204,000 - $247,000
#J-18808-Ljbffr