AI Infrastructure System Engineer
Listed by Jobgether for an employer it does not name
- LocationIndia
- Work typeRemote
- EmploymentFull-time
- Posted19 November 2026
- SourceListed by Jobgether (Lever)
Last checked31 min ago: still listed on Jobgether. First seen 2 h ago.
Moves fastWhen Jobgether takes a role down early, it is usually about 8 days after posting. Apply soon.
At a glance
- Experience3+ years
- Skills and toolsPython, Linux, Kubernetes, Terraform, Ansible
Read from the ad by RoleFinder, with rules and an AI reading; the description is the source.
About the role
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Infrastructure System Engineer based in India.
Join a team building and operating large-scale GPU infrastructure that powers advanced AI model training and inference. In this role, you will design software-driven systems to automate the entire lifecycle of GPU clusters, from provisioning and deployment to monitoring, repair, and retirement. You will develop intelligent automation and fleet management platforms that improve infrastructure availability, performance, and reliability across thousands of accelerators. Working at the intersection of software, hardware, networking, and AI, you will tackle complex distributed systems challenges at an exceptional scale. This is an opportunity for an engineer who prefers building systems over manual operations and is passionate about eliminating repetitive work through automation. Your contributions will help make large-scale AI infrastructure more autonomous, efficient, and resilient.
Accountabilities
-
Design and develop fleet automation systems to provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
-
Build AI infrastructure agents that automate deployments, identify root causes of failures, support incident triage, and execute autonomous remediation.
-
Develop fleet intelligence platforms to monitor hardware health, firmware, networking, storage, thermal conditions, and workload performance, enabling predictive failure detection.
-
Create software solutions that maximize GPU availability, utilization, performance, and reliability across large-scale accelerator fleets.
-
Build automated validation systems for GPUs, InfiniBand and RoCE networks, NVLink and NVSwitch technologies, storage infrastructure, and distributed AI workloads.
-
Develop internal platforms and tools that enable infrastructure teams to manage systems programmatically rather than relying on manual operations.
-
Continuously improve deployment speed, operational efficiency, and infrastructure reliability through automation and system optimization.
-
Collaborate with hardware, networking, platform, and AI engineering teams to advance the capabilities of large-scale AI infrastructure.
Requirements:
-
At least 3 years of experience building distributed systems, infrastructure platforms, or large-scale backend software.
-
Strong software engineering skills in at least one of the following languages: Python, Go, or Rust.
-
Practical experience developing platforms, automation systems, or developer infrastructure.
-
Familiarity with Linux and infrastructure technologies such as Kubernetes, Terraform, Ansible, or similar tools.
-
Strong systems-thinking abilities, with the capacity to understand and troubleshoot challenges spanning both hardware and software.
-
A passion for solving complex infrastructure problems through software engineering.
-
An automation-first mindset, with a strong preference for building systems that eliminate repetitive tasks and manual processes.
Bonus Experience:
-
Experience with GPU infrastructure, CUDA, NCCL, NVLink, or NVSwitch.
-
Knowledge of InfiniBand or RoCE networking technologies.
-
Experience with bare-metal provisioning and infrastructure lifecycle management.
-
Exposure to large-scale AI training or inference clusters.
-
Familiarity with hardware health monitoring and predictive failure detection.
-
Experience with distributed storage systems.
-
Knowledge of AI agents and autonomous infrastructure operations.
Benefits:
-
Opportunity to work on large-scale GPU infrastructure supporting advanced AI training and inference.
-
Exposure to complex engineering challenges across distributed systems, hardware, networking, and AI platforms.
-
Opportunity to build software and automation systems operating across thousands of accelerators.
-
Close collaboration with multidisciplinary engineering teams.
-
Professional growth through hands-on experience with emerging AI infrastructure technologies.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
Get open roles ranked against your CV
Add your CV once. RoleFinder ranks the open roles where you want to work, plus remote ones, against it, shows your best 12 with a one-line reason each, and emails you new matches once a week. The file is read once by AI and not kept; employers never see it.
Sign in with Google or email to start. How we handle your CV