Software Engineer - New Products
$165k/y-$330k/y
Basetena day ago
Highlight
OnsiteFull-time
Summary
Baseten is seeking a Software Engineer - New Products to join their team in San Francisco, CA. The role involves building new products and core platform capabilities for AI companies, focusing on infrastructure and system design.
About the Role
As a Software Engineer - New Products, you will join a small team responsible for developing API gateways, authentication systems, and observability tools that enable researchers and developers to ship AI products at scale. You will lead projects from architecture to long-term operations, design user-friendly APIs, and ensure the reliability of backend services.
About You
Required:
- Proven track record owning low-latency, reliable services (auth, rate limiting, quotas, usage metering, migrations).
- Strong infrastructure instincts: observability, incident response, SLOs, and capacity management.
- Comfort working across the stack when needed (backend-first, but willing to dive into frontend/CLI to unblock the product).
- Strong written communication, including clear design docs and effective cross-functional collaboration.
- Interest in AI/ML infrastructure and willingness to learn (ML expertise not required).
Preferred:
- Experience with API gateways, service meshes, Kubernetes, or distributed scheduling.
- Experience building developer platforms: SDKs, CLIs, APIs, and self-serve workflows.
- Experience with inference platforms, LLM runtimes, or performance-sensitive systems.
- Familiarity with multi-tenant isolation patterns (fair queuing, noisy-neighbor controls, admission control).
- Frontend experience (React/TypeScript) or strong product UX instincts for developer tools.
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!).
- Paid parental leave.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Baseten
Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.
San Francisco, CA