Senior AI Software Engineer, GenAI Framework
$148k/y-$287.5k/y
a day ago
Highlight
OnsiteFull-timeSenior
Summary
NVIDIA is seeking a Senior AI Software Engineer for their GenAI Framework team in Redmond, WA. The role focuses on expanding the capabilities of the Megatron Core and NeMo Framework for large language models and multimodal foundation model training.
About the Role
As a Senior AI Software Engineer, you will design and develop the GenAI open-source Megatron Core and NeMo Framework. Your responsibilities include solving large-scale AI training and inference challenges, innovating model architectures, and optimizing performance through advanced distributed training algorithms. You will collaborate with internal partners and the open-source community to implement highly optimized solutions.
About You
Required:
- MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related fields and 5+ years of industry experience.
- Experience with AI Frameworks (e.g. PyTorch, JAX) and/or inference and deployment environments (e.g. TRTLLM, vLLM, SGLang).
- Proficient in Python programming, software design, debugging, performance analysis, test design and documentation.
- Strong understanding of AI/Deep-Learning fundamentals and their practical applications.
Preferred:
- Hands-on experience in large-scale AI training with a deep understanding of core compute system concepts.
- Expertise in distributed computing, model parallelism, and mixed precision training.
- Prior experience with Generative AI techniques applied to LLM and Multi-Modal learning.
- Knowledge of GPU/CPU architecture and related numerical software.
- Contributions to open source deep learning frameworks.
Benefits
- Base salary range of $148k–$287k depending on level and experience.
- Eligibility for equity and comprehensive benefits.
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.
Redmond, WA