Senior AI Software Engineer

Senior AI Software EngineerAt Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company within global Accenture.

Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more. Join us to drive positive, lasting change that moves missions and the government forward!Job Description:We are looking for a Senior AI / Software Platform Engineer to help drive the integration of AI-assisted development workflows into a large-scale enterprise Linux environment.This role is focused on practical AI application within software engineering, including code intelligence, developer tooling, requirements-driven development, and AI-assisted modernization of a large legacy codebase consisting primarily of C/C++ with additional modern languages and frameworks.The ideal candidate is a strong software engineer first, with hands-on experience integrating and operationalizing modern AI/LLM technologies within real-world development environments.Environment:Large enterprise software platform (~6M+ LOC)Primarily C/C++Red Hat Enterprise Linux environmentGitLab-based development workflowsGPU-enabled internal AI infrastructureComplex legacy and modern hybrid systemsResponsibilities:Design, develop, and deploy scalable AI/ML and LLM-powered applications in production environmentsBuild and optimize high-performance inference pipelines using technologies such as vLLM and modern GPU-serving frameworksDevelop agentic AI workflows leveraging orchestration frameworks, tool calling, and retrieval-augmented generation (RAG)Integrate LLMs, vector databases, APIs, and enterprise systems into production applicationsCollaborate with software engineers, AI researchers, and platform teams to productionize AI prototypes and servicesImprove model performance, throughput, latency, scalability, and operational efficiencyImplement monitoring, observability, evaluation, and testing frameworks for AI systemsDevelop APIs, backend services, and automation workflows supporting AI-driven productsEvaluate emerging AI technologies, frameworks, and developer tooling including Open Code, OpenwebUI, Claude Code and modern AI coding assistantsContribute to AI platform architecture, deployment standards, and engineering best practicesRequired Skills:4 years of software development with experience in any of the following:Strong Linux experience (Red Hat / Enterprise Linux required)Experience with LLMs, RAG systems, embeddings, or AI-assisted toolingAdvanced C/C++ experienceExperience with GitLab workflows and CI/CDStrong Python development experienceExperience with APIs, backend systems, and automationStrong understanding of software architecture and large-scale systemsPreferred Skills:GPU infrastructure experienceExperience deploying or operating local/open-source modelsExperience with vector databases and semantic searchExperience with developer tooling or IDE integrationsExperience with AI evaluation/testing frameworksExperience with secure/offline AI environmentsFamiliarity with code indexing and static analysis systemsAbility to work independently and drive technical initiativesStrong debugging and problem-solving skillsExperience working with legacy systems and modernization effortsClearance:Must have an active secret federal security clearanceThe pay range for the states of California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Virginia, Washington, and the District of Columbia, and the city of Cleveland is:$115,300 - $160,100 USD