AI Infrastructure System Engineer
Together AIBangalore, India
Posted 4 months agoStill open, checked 8h ago
About the job
About the Role
At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrastructure role—we’re looking for engineers who love building systems, automating everything, and solving problems at massive scale.
If you enjoy writing software more than clicking dashboards, obsess over eliminating manual work, and want to build infrastructure that manages tens of thousands of GPUs autonomously, we’d love to talk.
Responsibilities
- Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
- Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation.
- Develop Fleet Intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures before they impact customers.
- Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators.
- Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
- Build internal platforms and developer tools that allow infrastructure to be managed through software—not manual operations.
- Continuously improve deployment velocity, reliability, and operational efficiency through automation.
- Partner closely with hardware, networking, platform, and AI teams to push the limits of AI infrastructure.
Requirements
- 3+ years building distributed systems, infrastructure platforms, or large-scale backend software.
- Strong software engineering skills in Python, Go, or Rust.
- Experience building platforms, automation systems, or developer infrastructure.
- Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
- Strong systems thinking with the ability to understand problems across hardware and software.
- A passion for solving complex infrastructure challenges through software.
- An automation-first mindset—if a task is repeated, your instinct is to build a system to eliminate it.
Bonus Experience
- GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch
- InfiniBand or RoCE networking
- Bare-metal provisioning and lifecycle management
- Large-scale AI training or inference clusters
- Hardware health monitoring and predictive failure detection
- Distributed storage systems
- AI agents and autonomous infrastructure operations
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
Similar jobs
Your Job Koch Technology is seeking an ambitious and curious IT Infrastructure Rotational Intern to join our team for a 12-week immersive internship experience. Unlike a traditional internship that focuses on a single technology discipline, this role offers the opportunity to rotate through three critical infrastructure organizations: Compute, Network, and Operations Infrastructure. You'll gain firsthand experience supporting the technology platforms that power a global enterprise. From enterprise Linux environments and cloud infrastructure to large-scale networking and operational excellence, you'll work alongside experienced engineers who design, build, operate, and continuously improve the foundational technology capabilities that enable Koch businesses around the world. This role is ideal for students who enjoy solving complex problems, learning new technologies, and building a broad understanding of modern enterprise infrastructure. Our TeamKoch Technology delivers innovative technology solutions that help create value across Koch's diverse businesses. The infrastructure organization provides the secure, scalable, and reliable technology foundation that enables employees, manufacturing facilities, customers, and business operations to remain connected and productive.As an Infrastructure Rotational Intern, you'll work directly with engineers and technical leaders across multiple disciplines, gaining exposure to enterprise-scale technologies, operational best practices, and real-world business challenges. Throughout the summer, you'll have opportunities to learn, contribute, and explore potential career paths while developing both technical capability and business acumen.What You Will Do Complete rotational assignments across Linux Compute, Network, and Operations Infrastructure teams Collaborate with experienced engineers to support technology platforms that enable business operations across a global enterprise Participate in real-world projects focused on infrastructure reliability, performance, scalability, and automation Develop technical knowledge through hands-on experience, mentorship, and exposure to enterprise technology environments Analyze operational data and system performance information to identify opportunities for improvement Contribute to documentation, process improvements, and knowledge-sharing initiatives Present key learnings, recommendations, and project outcomes throughout the internship experience Linux Compute Rotation Gain exposure to enterprise Linux environments that support critical business applications and services Assist with system administration, monitoring, automation, and infrastructure support activities Learn how operating systems, virtualization technologies, and cloud-based infrastructure work together to deliver reliable technology solutions Explore automation and scripting opportunities that improve operational efficiency and reduce manual effort Partner with engineers to troubleshoot issues and support continuous improvement initiatives Network Rotation Work alongside engineers responsible for connecting employees, manufacturing operations, data centers, cloud environments, and business applications across a global network Gain exposure to enterprise networking concepts including routing, switching, wireless technologies, DNS, and network security Assist with monitoring network performance, identifying trends, and supporting troubleshooting efforts Learn how modern networks are designed to provide resiliency, scalability, and secure connectivity for critical business operations Explore emerging technologies, automation capabilities, and operational practices that help improve network visibility and reliability Operations Infrastructure Rotation Support teams responsible for maintaining infrastructure availability, operational effectiveness, and service reliability Gain insight into incident response, infrastructure monitoring, operational processes, and continuous improvement initiatives Assist in evaluating infrastructure health and identifying opportunities to enhance user experience and system performance Contribute to efforts that strengthen operational excellence and business continuity Who You Are (Basic Qualifications) Currently pursuing a degree in Computer Science, Computer Engineering, Cybersecurity, Management Information Systems, or a related technical field with at least one semester or term remaining after the internship Eligible for full-time work by June 2028 Basic understanding of infrastructure technologies through coursework, labs, projects, or previous experience Strong analytical, problem-solving, and communication skills Curiosity and basic hands-on experience experimenting with AI/ML tools or generative assistants (Copilot, LLMs, AI APIs) or a clear willingness to learn and apply such tools safely under guidance. Legal authorization to work permanently in the United States for any employer without requiring visa transfer or visa sponsorshipWhat Will Put You Ahead Demonstrated curiosity, initiative, and passion for learning emerging technologies Experience with scripting or automation tools such as Python, Bash, PowerShell, or similar technologies Exposure to Linux operating systems through coursework, personal projects, labs, or previous experience Understanding of networking fundamentals including TCP/IP, routing, switching, DNS, or wireless networking concepts Exposure to cloud platforms such as Microsoft Azure or AWSAt Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.Hiring PhilosophyAll Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here.Who We AreAt Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.Our BenefitsOur goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.Equal OpportunitiesEqual Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, some offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please click here for additional information. (For Illinois E-Verify information click here, aquí, or tu).
KochPlano, US
Your JobAre you passionate about transforming data into insights that drive business decisions? Koch Engineered Solutions (KES) is seeking a Data Engineering Intern to join our Data and Analytics team. In this role, you will work alongside experienced data engineers and business partners to develop, maintain, and improve data solutions that enable operational excellence and business value creation. This internship provides hands-on experience with modern data platforms, cloud technologies, data pipelines, and analytics tools while contributing to real-world projects.Our TeamAt Koch Engineered Solutions, we deliver innovative and sustainable solutions for complex industrial challenges. Our IT Data and Analytics team plays a critical role in bridging the gap between data products and software engineering by building the infrastructure and integrations that power data-driven decision-making. We are seeking a curious and motivated Data Engineering Intern who is passionate about coding, problem-solving, and working closely with business stakeholders to turn data challenges into real-world solutions. This internship is based in office in Wichita, KS or Houston, TX and designed for students interested in gaining hands-on experience in data engineering.What You Will DoCollaborate with Data Scientists, Data Architects, Analytics Engineers, and business stakeholders to understand problem statements and translate them into technical solutionsClean, transform, and integrate data from various sources (structured and unstructured).Collaborate with team members to troubleshoot issues and optimize performance of data workflows.Document data architecture, workflows, and best practices.Develop and maintain data integrations, pipelines, and repositories using SQL, Python, dbt, and scripting languagesDive into data details and perform analysis and synthesis to identify opportunities for process improvementsTake ownership of assigned projects and troubleshoot issues independently, escalating thoughtfully when necessaryDesign and model data solutions using Kimball dimensional modeling principles aligned to business processes and reporting requirements.Gain exposure to modern cloud-based data platforms such as AWS and SnowflakeParticipate in Agile ceremonies including sprint planning, daily stand-ups, sprint reviews, and retrospectives to gain exposure to Agile project management and team collaboration practices.Who You Are (Basic Qualifications)Currently enrolled in a degree program related to one of the following areas: Computer Science, Management Information Systems, Data Engineering, Software Engineering, Analytics or related technical field with at least one semester or term remaining after the internshipFamiliarity with Python through coursework, projects, or internships.Experience writing and troubleshooting SQL queries to extract and manipulate data from relational databases.Curiosity and basic hands-on experience experimenting with AI/ML tools or generative assistants (Copilot, LLMs, AI APIs) or a clear willingness to learn and apply such tools safely under guidance.Eligible for full-time employment by June 2028Legal authorization to work permanently in the United States for any employer without requiring a visa transfer or visa sponsorshipWhat Will Put You AheadInitiative, natural curiosity, strong communication skills, and an aptitude for fast-paced learning Familiarity with analytics, visualization, or business intelligence toolsKnowledge of data warehousing, ETL/ELT concepts, or data modelingExperience building AI-powered agents, copilots, or workflow automations using Power BI, Snowflake, or related AI-enabled platforms.Willingness to learn and interest in using cloud platforms and big data technologies (AWS, Snowflake, Redshift, dbt, git, MS Fabric)At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.Hiring PhilosophyAll Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here.Who We AreAs a Koch company, Koch Engineered Solutions (KES) is a dynamic network of businesses that work together to create an ecosystem of domain expertise to increase operational efficiency, improve safety, reduce waste, and reduce emissions.At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.Our BenefitsOur goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.Equal OpportunitiesEqual Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, some offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please click here for additional information. (For Illinois E-Verify information click here, aquí, or tu).
KochHouston, Texas | Wichita, Kansas