Data Architect – Databricks
2 days ago
Highlight
OnsiteFull-timeSenior
Summary
Confidential Jobs is seeking a Data Architect – Databricks to join their team in Santa Clara, CA. The role involves leading the design, implementation, and optimization of enterprise data architecture using Databricks.
About the Role
As a Data Architect – Databricks, you will be responsible for designing and implementing robust, scalable, and secure data architectures. You will collaborate with data engineers, analysts, and business stakeholders to define data models and governance strategies, develop data lakehouses, and ensure data quality and compliance. Additionally, you will lead migration efforts from legacy systems to modern cloud-based platforms and mentor junior team members.
About You
Required:
- 12+ years of experience in data architecture, with 5+ years hands-on in Databricks.
- Strong experience in Snowflake.
- Experience in cloud platforms AWS, especially AWS Databricks.
- Strong proficiency in Apache Spark, Delta Lake, and PySpark.
- Experience with data modeling, ETL/ELT pipelines, and data warehousing.
- Familiarity with CI/CD, DevOps, and Infrastructure as Code (Terraform, ARM templates).
- Knowledge of data governance, security, and compliance frameworks.
- Excellent communication and stakeholder management skills.
Preferred:
- Databricks Certified Data Engineer or Architect.
- Experience with MLflow, Unity Catalog, and Lakehouse architecture.
- Background in machine learning, AI, or advanced analytics.
- Experience with tools like Apache Airflow, dbt, or Power BI/Tableau.
Confidential Jobs
Confidential Jobs is operated by ExecThread, Inc. (https://execthread.com). ExecThread is a job discovery platform that provides high-caliber professionals with scalable access to thousands of confidential Board roles & Exec-level career opportunities. Our platform creates transparency in an otherwise opaque & clandestine executive recruiting market. 800k+ executives, and thousands of employers & recruiting firms, leverage ExecThread to discover opportunities and talent alike.
Santa Clara County, CA