Member of Technical Staff - Model Evaluation
$180k/y-$440k/y
xAIHighlight
OnsiteFull-timeEntry
Summary
xAI is seeking a Member of Technical Staff - Model Evaluation to join their team in Palo Alto, CA. The role focuses on assessing and improving AI model quality through evaluation and collaboration with data teams.
About the Role
As a Member of Technical Staff - Model Evaluation, you will provide complete assessments of models, conduct deep dives into model training and data to identify weaknesses, and communicate with modeling and data teams to develop plans for improving model quality. You will work with a tech stack that includes Python, JAX, XLA, Rust, C++, and Spark.
About You
Required:- Experience in model assessment and evaluation task development.
- Strong communication skills to share knowledge effectively with teammates.
Preferred:- Familiarity with inference frameworks like SGlang and vLLM.
- Experience in building infrastructure and frameworks for model evaluation.
Benefits
- Equity in the company.
- Comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan.
- Short & long-term disability insurance.
- Life insurance and various other discounts and perks.
Company Size: 11-50 employeesTechnology, Information and Internet