Founding Engineer, Data Platform
$185k/y-$270k/y
Elicita day ago
Highlight
HybridFull-timeSenior
Summary
Elicit is seeking a Founding Engineer, Data Platform to join their team in Oakland, CA. The role involves architecting and implementing robust, scalable solutions to handle growing data needs while maintaining high performance and data quality.
About the Role
As a Founding Engineer, Data Platform, you will be responsible for building a complete corpus of academic papers and clinical trials, optimizing data ingestion processes, and expanding the datasets Elicit works with. You will work with a tech stack that includes Python, Flyte, and Spark, and will play a key role in shipping new features to users.
About You
Required:
- 5+ years of experience as a data engineer, owning decisions about data ingestion and management.
- Strong proficiency in Python with 5+ years of experience.
- Experience with architecting and optimizing large data pipelines, ideally with Spark.
- Strong SQL skills, including understanding of aggregation functions, window functions, UDFs, self-joins, partitioning, and clustering approaches.
- Experience with columnar data storage formats like Parquet.
Preferred:
- Experience in developing deduplication processes for large datasets.
- Hands-on experience with full-text extraction and processing from various document formats (PDF, HTML, XML, etc.).
- Familiarity with machine learning concepts and their application in search technologies.
- Experience with distributed computing frameworks beyond Spark (e.g., Dask, Ray).
- Experience in science and academia, familiar with academic publications.
Benefits
- Flexible work environment: work from the office in Oakland or remotely.
- Fully covered health, dental, vision, and life insurance for you and your family.
- Flexible vacation policy with a minimum recommendation of 20 days/year + company holidays.
- 401K with a 6% employer match.
- A new Mac + $1,000 budget to set up your workstation in your first year, then $500 every year thereafter.
- $1,000 quarterly AI Experimentation & Learning budget.
- A team administrative assistant to help with personal and work tasks.
Elicit
Elicit, the AI research assistant, helps you automate time-consuming research tasks like summarizing papers, extracting data, and synthesizing your findings. We're a public benefit company with a mission to scale up good reasoning. We want machine learning to help as much with thinking and reflection as it does with tasks that have clear short-term outcomes.
Oakland, CA