Software Engineer - Model Training
$165k/y-$330k/y
Baseten17 hours ago
Highlight
OnsiteFull-timeSenior
Summary
Baseten is seeking a Software Engineer - Model Training to join their team in San Francisco, CA. The role involves building the infrastructure for large-scale training and fine-tuning of foundation models.
About the Role
As a Software Engineer – Model Training at Baseten, you will design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines for model adaptation. This highly technical role requires collaboration with product and infrastructure teams to meet customer needs and advance scalable training infrastructure.
About You
Required:
- Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
- 5+ years of experience in ML infrastructure, distributed systems, or ML platform engineering, including 2+ years in a tech lead or manager role.
- Strong expertise in distributed training frameworks and orchestration (FSDP, DDP, ZeRO, Ray, Kubernetes, Slurm, or similar).
- Hands-on experience building or scaling training infrastructure for LLMs or other foundation models.
- Deep understanding of GPU/accelerator hardware utilization, mixed precision training, and scaling efficiency.
- Proven ability to lead and mentor technical teams while delivering complex infrastructure projects.
- Excellent communication skills, with the ability to bridge technical depth and business needs.
Preferred:
- Experience building APIs, SDKs, or developer tools for ML workflows.
- Familiarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.).
- Knowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelines.
- Contributions to open-source distributed training or ML infra projects.
- Experience with cloud environments (AWS, GCP, Azure) and container orchestration.
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!).
- Paid parental leave.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Baseten
Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.
San Francisco, CA