Unknown Company

Senior Server Administrator

chicago, il • Posted 5 days ago
Hybrid Contract Technical Support & Administration

We’re hiring a Senior Server Administrator to join our client’s AI Engineering team . This role is pivotal in deploying, maintaining, and optimizing high-performance computing infrastructure leveraging NVIDIA GPU technologies . You will collaborate with AI researchers, data scientists, and software engineers to ensure systems are robust, scalable, and tuned for cutting‑edge machine learning workloads .

Base pay range

$70.00/yr - $75.00/yr

Job Title: Senior Server Administrator

Location: Chicago/ Peoria, Cary, Phoenix

Contract: 12 Months

Work Environment: Hybrid: 1 day/week onsite, transitioning to 5 days/week onsite when notified.

Hourly Rate: $70-75 (W2)

Key Responsibilities:

  • Administer and maintain GPU‑accelerated servers and clusters (NVIDIA A100, H100, etc.).
  • Manage and optimize NVIDIA software stack (CUDA, cuDNN, TensorRT, NCCL, NGC containers).
  • Monitor system performance, troubleshoot issues, and ensure high availability.
  • Support containerized workflows (Docker, Kubernetes) and distributed training environments.
  • Implement security best practices and compliance standards.
  • Lead upgrades, patching, and lifecycle management of GPU servers.
  • Provide documentation, automation scripts, and training for internal teams.

What We’re Looking For:

  • Bachelor’s Degree with 8+ years of experience , including 5+ years in server administration and 3+ years with NVIDIA GPU‑based systems .
  • Strong Linux administration skills in HPC or AI environments.
  • Hands‑on experience with NVIDIA GPU drivers, CUDA toolkit, and performance tuning.
  • Familiarity with Slurm, Kubernetes, and orchestration tools.
  • Experience with monitoring tools (Prometheus, Grafana) and automation (Ansible, Terraform).

Strong expertise in:

  • NVIDIA Certified Professional or similar credentials.
  • Experience with multi‑GPU/multi‑node training setups.
  • Familiarity with AI/ML frameworks (PyTorch, TensorFlow).
  • Exposure to cloud‑based GPU infrastructure (AWS, Azure, GCP).

About us:

Harvey Nash is a national, full‑service talent management firm specializing in technology positions. Our company was founded with a mission to serve as the talent partner of choice for the information technology industry.

Our company vision has led us to incredible growth and success in a relatively short period of time and continues to guide us today. We are committed to operating with the highest possible standards of honesty, integrity, and a passionate commitment to our clients, consultants, and employees.

We are part of Nash Squared Group, a global professional services organization with over forty offices worldwide.

Please visit us at

Harvey Nash will provide benefits please review: 2025 Benefits -- Corporate

#J-18808-Ljbffr
Back to Job Search