Arkhya Tech Inc.

Infrastructure Architect

Charlotte, NC • Posted 5 days ago
Onsite Full Time IT Services and IT Consulting

Role : Infrastructure Architect

Location : Charlotte NC (Onsite)

Duration: Long Term


The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.

Lead architecture and technical direction for:

  • Enterprise GenAI Platform
  • Agentic AI Platform
  • Model Serving Infrastructure
  • Prompt and Evaluation Frameworks
  • AI Governance and Guardrails
  • Agent Runtime Platforms
  • Observability and AI Operations


Multi-Cloud AI Platform

Design and drive architecture across:

  • OpenShift AI / RHOAI
  • GCP Vertex AI
  • Gemini Models
  • Azure AI Foundry
  • AWS Bedrock
  • Anthropic Claude
  • OpenAI


Platform Scalability & Resiliency

Lead initiatives involving:

  • Capacity planning
  • GPU platform strategy
  • NVIDIA Super POD architecture
  • Multi-region resiliency
  • Cloud DR strategy
  • Active-active platform architectures
  • High availability and disaster recovery


Required Qualifications

  • 10+ years of software engineering, Infrastructure, and architecture experience.
  • 5+ years designing large-scale cloud-native platforms.
  • Strong experience with:
  • Kubernetes/OpenShift
  • Distributed systems
  • Cloud architectures
  • AI/ML platforms
  • API platforms
  • Data platforms
  • Deep understanding of:
  • Generative AI
  • RAG architectures
  • Agentic AI
  • Model Serving
  • MLOps
  • Experience designing highly available Tier-1 production systems


Infrastructure Architect in Charlotte at Arkhya Tech Inc.

This position is listed as full time and onsite. It was posted 5 days ago.

See all Arkhya Tech Inc. jobs on LocalWork →

Back to Job Search