Staff Software Engineer, Enterprise GenAI

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability.

You will:

• Own large new areas within our product

• Work across backend, frontend, and interacting with LLMs and ML models

• Deliver experiments at a high velocity and level of quality to engage our customers

• Work across the entire product lifecycle from conceptualization through production

• Be able, and willing, to multi-task and learn new technologies quickly

Ideally you'd have:

• 7+ years of full-time engineering experience, post-graduation

• Experience scaling products at hyper growth startups

• Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies

• Proficient in Python or Javascript/Typescript, and SQL

• Experience with Kubernetes

• Experience with major cloud providers (AWS, Azure, GCP)

Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on wo

Department: Applications Platform Engineering