Engineering Manager - Forward Deployed Engineering (LLM)
$260k/y-$380k/y
Baseten20 hours ago
Highlight
OnsiteFull-timeMid
Summary
Baseten is seeking an Engineering Manager - Forward Deployed Engineering (LLM) to join their team in San Francisco, CA. The role involves leading and mentoring a team focused on building, scaling, and optimizing LLM inference workloads for Baseten customers.
About the Role
As an Engineering Manager (Player & Coach), you will guide your team through designing, deploying, and managing high performance, low latency AI applications. You will collaborate with product, infrastructure, and customer engineering teams to ensure optimal performance and reliability of large language models in production environments.
About You
Required:
- Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
- 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity.
- Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
- Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, Hugging Face, Ray Serve).
- Excellent communication and collaboration skills.
Preferred:
- Experience leading customer-facing engineering teams or working directly with enterprise partners.
- Deep understanding of GPU infrastructure, distributed inference, or model compression techniques.
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Generous PTO policy including company wide Winter Break.
- Paid parental leave.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Baseten
Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.
San Francisco, CA