Applied Research Engineer
$180k/y-$220k/y
odiggoa day ago
Highlight
OnsiteFull-timeMid
Summary
Sully.ai is seeking an Applied Research Engineer to join their team in Mountain View, CA. The role involves building and scaling automated evaluation pipelines with clinical-grade benchmarks to enhance AI-driven healthcare solutions.
About the Role
As an Applied Research Engineer, you will be responsible for designing agentic processes and LLM evaluation frameworks. Your tasks will include auditing existing evaluation approaches, defining benchmarks, and delivering a repeatable evaluation framework with automated pipelines in production. You will work closely with engineering teams to ensure accuracy, factuality, and safety in AI applications.
About You
Required:
- Proven experience designing agentic processes and LLM evaluation/benchmarking frameworks.
- Strong Python and ML background (PyTorch/TensorFlow, Hugging Face, LangChain/LlamaIndex).
- Demonstrated ability to design rigorous experiments and translate findings into production.
- Track record of published research or deep applied work in LLMs and agent evaluation.
- Strong communication and technical writing skills to articulate complex findings clearly.
Benefits
- Opportunity to work on impactful healthcare solutions.
- Collaborative and fast-paced work environment.
- Ownership and autonomy in your role.
odiggo
Car Services in minutes
Mountain View, CA