Senior Databricks Engineer
SysTechCorp Inc3 months ago
Highlight
OnsiteFull-timeSenior
Summary
SysTechCorp Inc is seeking a Senior Databricks Engineer to join their team in the United States. The role involves designing, developing, and maintaining ETL/ELT pipelines on Databricks using Spark, PySpark, or Scala.
About the Role
As a Senior Databricks Engineer, you will be responsible for building scalable, high-performance data models and workflows for analytics and machine learning applications. You will collaborate with Data Architects, Data Scientists, and Analysts to understand business requirements and translate them into data solutions. Your daily tasks will include implementing best practices for data quality, governance, and security, optimizing data pipelines for performance and cost-efficiency, and mentoring junior engineers.
About You
Required:
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
- 10+ years of experience in data engineering or software engineering roles.
- 5+ years of hands-on experience with Databricks and Apache Spark (PySpark/Scala).
- Strong experience with ETL/ELT processes and data pipeline orchestration (Airflow, Azure Data Factory, or similar).
- Solid understanding of cloud platforms (AWS, Azure, or GCP) and cloud-based data architectures.
- Proficiency in SQL and experience with relational and NoSQL databases.
- Experience with data modeling, partitioning, and performance tuning in big data environments.
- Familiarity with version control (Git) and CI/CD pipelines.
- Excellent problem-solving skills and ability to work in a collaborative Agile environment.
Preferred:
- Experience with Delta Lake, MLflow, or other Databricks-specific tools.
- Exposure to real-time streaming data frameworks (Kafka, Kinesis).
- Familiarity with data governance and compliance frameworks (GDPR, HIPAA).
SysTechCorp Inc
SysTechCorp Inc provides leading-edge technology services that empower our clients to meet and exceed their strategic business objectives. Our AI, ML, Mobile, Cloud, and ERP practice is backed by years of experience and deep domain expertise in a wide range of industry verticals.
United States