Principal Software Engineer - Dynamo
$272k/y-$431k/y
NVIDIA2 days ago
Highlight
OnsiteFull-timeDirector
Summary
NVIDIA is seeking a Principal Software Engineer - Dynamo to join their team in Santa Clara, CA. The role involves addressing high-impact challenges in distributed inference for large language models in GPU environments.
About the Role
As a Principal Software Engineer on the Dynamo project, you will build the Kubernetes deployment and workload management stack, develop robust inference workload management systems, architect disaggregated serving, and enhance intelligent routing and KV-cache management. You will collaborate on design and development, introduce new features, and contribute to open-source repositories while ensuring peak performance at scale.
About You
Required:
- BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience).
- 15+ years of proven experience in related field.
- Strong proficiency in systems programming (Rust and/or C++), with experience in Python for workflow and API development.
- Deep understanding of distributed systems, parallel computing, and GPU architectures.
- Experience with cloud-native deployment and container orchestration (Kubernetes, Docker).
- Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads.
- Background with memory management, data transfer optimization, and multi-node orchestration.
- Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment).
- Excellent problem-solving and communication skills.
Preferred:
- Prior contributions to open-source AI inference frameworks (e.g., vLLM, TensorRT-LLM, SGLang).
- Experience with GPU resource scheduling, cache management, or high-performance networking.
- Understanding of LLM-specific inference challenges, such as context window scaling and multi-model agentic workflows.
Benefits
- Highly competitive salaries.
- Comprehensive benefits package including equity.
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.
Santa Clara, CA