LLMOps Lead
$100k/y-$300k/y
Cognichip Inc.2 days ago
Highlight
OnsiteFull-timeSenior
Summary
Cognichip is seeking a Staff LLMOps Engineer to join their team in Redwood City, CA. The role involves architecting, deploying, and optimizing large language model (LLM) infrastructure on the cloud to enhance productivity for semiconductor design engineers.
About the Role
As a Staff LLMOps Engineer, you will design and implement production-ready LLM deployment pipelines on AWS and Kubernetes/EKS, build and scale LLM inference infrastructure for high availability and low latency, and optimize inference performance. You will collaborate with AI researchers to operationalize model training outputs and establish monitoring for LLM serving. Additionally, you will drive automation of infrastructure provisioning and partner with security teams to ensure secure model hosting.
About You
Required:
- 5+ years of experience in DevOps/AI infrastructure, with 2+ years focused on LLMOps.
- Proven track record of deploying and scaling LLMs in production environments.
- Hands-on experience with GPU-accelerated inference and distributed AI serving.
- Strong understanding of cloud-native architectures and secure enterprise SaaS deployment.
Benefits
- Opportunity to own and scale LLM infrastructure at a disruptive AI startup.
- Competitive compensation package, including equity participation.
- A team of high-caliber collaborators at the intersection of AI, cloud, and semiconductor design.
- A culture of innovation, precision, and impact, where your work directly shapes the future of engineering.
Cognichip Inc.
Cognichip is developing the world’s first Artificial Chip Intelligence (ACI®) to reimagine chip design. Founded by experts from Amazon, Google, Apple, Aquantia, Synopsys, and KLA, the company tackles high cost and inaccessibility in chip development, enabling hardware to evolve as quickly as AI software innovation. Backed by $33 million in seed funding from Mayfield, Lux Capital, FPV, and Candou Ventures, Cognichip’s ACI® features a first-of-its-kind physics-informed foundation model, purposely built for semiconductors. ACI® accelerates innovation and broadens access to semiconductor technology by making it easier, more affordable, and accessible to a broader range of innovators. Learn more at www.cognichip.ai.
Redwood City, CA