Senior Deep Learning Software Engineer, Inference and Model Optimization
$184k/y-$356.5k/y
NVIDIAa day ago
Highlight
OnsiteFull-timeSenior
Summary
NVIDIA is seeking a Senior Deep Learning Software Engineer, Inference and Model Optimization to join their team in Santa Clara, CA. The role focuses on optimizing generative AI models for maximal inference efficiency and developing an innovative software platform.
About the Role
As a Senior Deep Learning Software Engineer, you will develop and scale automated inference and deployment solutions, working with high-level frameworks like PyTorch and HuggingFace, and improving high-performance kernel implementations in CUDA, TRT-LLM, and Triton. You will analyze GPU kernel performance, innovate on inference performance, and architect a modular software platform to enhance user experience and model support.
About You
Required:
- Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field.
- 5+ years of relevant work or research experience in Deep Learning.
- Excellent software design skills, including debugging, performance analysis, and test design.
- Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace).
- Strong algorithms and programming fundamentals.
- Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment.
Preferred:
- Contributions to PyTorch, JAX, or other Machine Learning Frameworks.
- Knowledge of GPU architecture and compilation stack, and capability of understanding and debugging end-to-end performance.
- Familiarity with NVIDIA's deep learning SDKs such as TensorRT.
- Prior experience in writing high-performance GPU kernels for machine learning workloads in frameworks such as CUDA, CUTLASS, or Triton.
Benefits
- Highly competitive salaries.
- Comprehensive benefits package including equity.
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.
Santa Clara, CA