Primary record

Infrastructure Software Engineer, Enterprise GenAI

Scale AI Indexed employerSan Francisco, CA; New York, NY · San Francisco, California, United States
Source-hosted applyChecked 1h agoInternship
Apply at Scale AI

Scale AI receives this application through Greenhouse. Babu Careers does not claim delivery.

Workplace

On-site

Employment

Internship

Published

Aug 11, 2026

Closes

No date supplied

The role

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment.

The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.

What You’ll Do:

• Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers

• Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)

• Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs.

• Deliver experiments at a high velocity and level of quality to engage our customers

• Work across the entire product lifecycle from conceptualization through production

• Be able, and willing, to multi-task and learn new technologies quickly

What We’re Looking For:

• 4+ years of full-time engineering experience, post-graduation

• Experience scaling products at hyper growth startups

• Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies

• Proficient in Python or Javascript/Typescript, and SQL

• Experience with Kubernetes

• Experience with major cloud providers (AWS, Azure, GCP)

• Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences </

Requirements

Department: Applications Platform Engineering