Senior AI System Engineer
$148k/y-$287.5k/y
2 days ago
Highlight
OnsiteFull-timeSenior
Summary
NVIDIA is seeking a Senior AI System Engineer to join their team in Santa Clara, CA. The role involves contributing to the development of next-generation inference optimizations and delivering industry-leading performance in AI systems.
About the Role
As a Senior AI System Engineer, you will optimize inference deployment at datacenter scale, develop high-fidelity performance models, and prioritize features for future software and hardware roadmaps. You will collaborate with diverse teams to drive model-hardware co-design for Generative AI and keep up with the latest deep learning research.
About You
Required:
- Master's degree in Computer Science, Electrical Engineering, or related fields.
- 3+ years of hands-on experience in system evaluation of AI/ML workloads or performance analysis.
- Strong background in computer architecture, roofline modeling, queuing theory, and statistical performance analysis techniques.
- Solid understanding of ML fundamentals, model parallelism, and inference serving techniques.
- Proficiency in Python (and optionally C++) for simulator design and data analysis.
- Experience with GPU computing (CUDA).
- Experience with deep learning frameworks like PyTorch, TRT-LLM, VLLM, SGLang.
Preferred:
- Comfortable defining metrics, designing experiments, and visualizing large performance datasets.
- Proven track record of working in cross-functional teams spanning algorithms, software, and hardware architecture.
- Ability to distill complex analyses into clear recommendations for both technical and non-technical stakeholders.
Benefits
- Base salary range of $148k–$287.5k depending on level and experience.
- Eligibility for equity and comprehensive benefits.
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.
Santa Clara, CA