Staff Software Engineer, ML Infrastructure
$300k/y-$430k/y
Decagona day ago
Highlight
OnsiteFull-timeSenior
Summary
Decagon is seeking a Staff Software Engineer, ML Infrastructure to join their team in San Francisco, CA. The role involves owning the platforms for model training and inference, building distributed training systems, and designing inference architecture.
About the Role
As a Staff ML Infrastructure Engineer, you will design and build distributed training platforms for LLM and multimodal fine-tuning, implement state-of-the-art training algorithms, own inference architecture, and lead initiatives to improve latency and cost efficiency. You will also mentor engineers and establish best practices for ML infrastructure.
About You
Required:
- 8+ years building ML infrastructure or production systems at scale.
- Deep experience with distributed training: multi-node GPU clusters, fault tolerance, and optimization.
- Strong understanding of LLM inference: latency optimization, provider tradeoffs, and serving architecture.
- Proficiency in Python and modern ML frameworks (PyTorch, JAX, or TensorFlow).
- Proven track record leading complex, multi-quarter technical projects.
Benefits
- Medical, dental, and vision benefits.
- Take what you need vacation policy.
- Daily lunches, dinners and snacks in the office.
Decagon
Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experience. Our AI agents provide intelligent, human-like responses across chat, email, and voice, resolving millions of customer inquiries across every language and at any time. We partner with industry leaders like Hertz, Eventbrite, Duolingo, Oura, Bilt, Curology, and Samsara to redefine customer experience at scale. Decagon is backed by Accel, Andreessen Horowitz, Bain Capital Ventures, BOND, A*, Elad Gil, and the founders of Box, Airtable, Rippling, Okta, and more.
San Francisco, CA