ML Features Solutions Engineer
SambaNovaHighlight
Summary
About the Role
About You
- Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, or related field.
- 5+ years of industry experience in ML engineering or applied ML research.
- 3+ years of hands-on experience with large language models and transformer architectures.
- Expert proficiency in Python and deep learning frameworks: PyTorch (required), TensorFlow, or JAX.
- Experience with model optimization techniques: quantization, pruning, distillation, efficient inference.
- Strong understanding of LLM inference optimization: KV cache, batching strategies, memory management.
- Experience deploying ML models to production at scale.
- Track record of translating research concepts into production features.
- PhD in Machine Learning, NLP, or related field.
- Experience with custom hardware acceleration (TPUs, custom ASICs).
- Hands-on experience with inference frameworks: vLLM, TensorRT-LLM, or similar.
- Experience with function calling and tool use in LLMs.
- Knowledge of structured generation and constrained decoding.
- Experience with ML feature development in enterprise contexts.
- Contributions to open-source ML projects.
Benefits
- Competitive total rewards package including base salary, equity, and benefits.
- 95% premium coverage for employee medical insurance and 77% for dependents.
- Health Savings Account (HSA) with employer contribution.
- Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans.
- Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
- Well-being benefits including Headspace subscription, Gympass+ membership, One Medical membership, and counseling services.
Welcome to SambaNova: Revolutionizing AI Capacity At SambaNova, we're empowering developers, enterprises, governments, and data centers to unlock their full AI potential. Our full-stack infrastructure, from chips to models, enables lightning-fast performance, low power consumption, and high-efficiency computing. Our Mission To give every developer, enterprise, government and data center absolute sovereignty over their own data, models and AI infrastructure – to future-proof the AI workloads that will power and scale tomorrow. Our Technology We give our customers the optionality to experience SambaNova through the cloud or on-premise. Samba Cloud delivers the fastest inferences on the largest open source models like Llama 4 and DeepSeek. Developers can get started building in minutes with our OpenAI compatible APIs. All customers start on the developer tier and when they need more capacity can scale into our enterprise tier. SambaStack is our on-premise offering which includes the system, the platform, and foundation models. These components combine into a powerful technology stack that delivers unparalleled performance, ease of use, accuracy, data privacy, and the ability to power every use case across the world's largest organizations. SambaManaged is a modular and ready-to-deploy AI cloud designed to deliver unmatched efficiency for data centers and cloud service providers. This solution allows organizations to quickly deploy advanced AI inference services—without the need for costly infrastructure upgrades or specialized expertise—in as little as 90 days. At the heart of SambaNova innovation is the Reconfigurable Dataflow Unit (RDU). Purpose built for AI workloads, the RDU takes advantage of a dataflow architecture and a three-tiered memory design. The three tiers of memory enable the platform to run hundreds of models on a single node and to switch between them in microseconds. In 2023, SambaNova released its 4th generation RDU chip, the SN40L.