Site Reliability Engineer, Inference Infrastructure
Coherea day ago
Highlight
OnsiteFull-timeSenior
Summary
Cohere is seeking a Site Reliability Engineer, Inference Infrastructure to join their team in San Francisco, CA. The role involves developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints.
About the Role
As a Site Reliability Engineer, you will be responsible for building self-service systems that automate managing, deploying, and operating services, including custom Kubernetes operators. You will automate environment observability and resilience, ensure defined SLOs are met, and build strong relationships with internal developers to influence the Infrastructure team's roadmap. Additionally, you will participate in knowledge sharing and an active review process within the team.
About You
Required:
- 5+ years of engineering experience running production infrastructure at a large scale.
- Experience designing large, highly available distributed systems with Kubernetes and GPU workloads.
- Experience with Kubernetes development and production support.
- Experience with GCP, Azure, AWS, OCI, and multi-cloud on-prem/hybrid serving.
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based environments.
- Excellent collaboration and troubleshooting skills.
Preferred:
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, etc.).
- Strong understanding or working experience with distributed systems.
- Experience in Golang, C++, or other languages designed for high-performance scalable servers.
Benefits
- An open and inclusive culture and work environment.
- Work closely with a team on the cutting edge of AI research.
- Weekly lunch stipend, in-office lunches & snacks.
- Full health and dental benefits, including a separate budget for mental health.
- 100% Parental Leave top-up for up to 6 months.
- Personal enrichment benefits towards arts and culture, fitness and well-being.
- Remote-flexible work options with offices in multiple cities.
- 6 weeks of vacation (30 working days!).
Cohere
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation models and end-to-end AI products designed to solve real-world business problems. We partner closely with companies to deliver seamless integration, full customization, and easy-to-use solutions for their workforce and customers. Our all-in-one platform offers enterprises the highest levels of data security, privacy and optionality to deploy across all major cloud providers, private cloud environments, or on-premises.
San Francisco, CA