Lead LLM Engineer
2 days ago
Highlight
OnsiteFull-timeSenior
Summary
RENFROE® is seeking a Lead LLM Engineer to join their team in the United States. The role involves owning the design, deployment, and optimization of their Azure-based LLM stack, focusing on cutting-edge ML techniques for intelligent claims solutions.
About the Role
As a Lead LLM Engineer, you will lead the design and deployment of large language model infrastructure using Azure ML and AKS. Your responsibilities will include fine-tuning transformer models for quality assurance, building and managing vector stores and retrieval pipelines, developing low-latency inference services, optimizing model performance, and collaborating with cross-functional teams to deliver high-impact AI capabilities.
About You
Required:
- Deep experience fine-tuning transformer models using LoRA, QLoRA, and PEFT.
- Building retrieval pipelines with vector databases (FAISS, Pinecone).
- Proficient in Python and familiar with Go or Java microservices.
- Containerized deployment using Docker and Kubernetes (AKS), with Azure ML and Azure Container Instances.
- API development with FastAPI or Flask; Azure AD integration and secret management via Key Vault.
- Experience with model optimization (quantization, distillation) and monitoring (Azure Monitor, Grafana).
Preferred:
- Bachelor’s degree in Computer Science, Data Science, or related field; Master’s preferred.
- 6–10+ years of experience in AI/ML engineering, with hands-on deployment of LLMs in production.
- Demonstrated success building scalable, enterprise-grade ML systems, ideally in regulated industries.
- Strong track record of architectural ownership and mentoring in a high-performance team.
- Effective cross-functional communicator with a focus on delivering production-ready AI solutions.
Benefits
- Opportunities for professional growth and continuous learning.
- A culture built on strong values including excellence, growth, curiosity, empathy, integrity, and service.
RENFROE®
RENFROE® provides a full range of catastrophe support services to insurance companies, self-insured corporations and governmental entities during times of disaster. We are one of the largest firms in the country that specialize in catastrophe claims management. Our staff has managed both manmade and natural catastrophe projects throughout the United States, including oil spills, explosions, product liability/product recall, chemical releases, hail storms, wildfires, hurricanes, earthquakes, tornados and ice storms.
United States