Sr. Data Engineer
$103k/y-$154k/y
a day ago
Highlight
OnsiteFull-timeSenior
Summary
Pyramid Systems, Inc. is seeking a Sr. Data Engineer to join their team in Fairfax, VA. The role involves creating and maintaining data architectures, optimizing data processes, and supporting AI/ML teams.
About the Role
As a Sr. Data Engineer, you will be responsible for planning, creating, and maintaining data architectures that align with business requirements. Your tasks will include obtaining data, formulating dataset processes, identifying and solving inefficiencies, and automating manual tasks. You will also manage data lifecycle policies, monitor data pipelines, and ensure high data quality through data quality gates. Additionally, you will support AI/ML teams and maintain documentation related to data transformations and pipeline schedules.
About You
Required:
- 8+ years of IT experience focusing on enterprise data architecture and management.
- Bachelor's degree in Computer Science or related discipline.
- Experience with Databricks, Structured Streaming, Delta Lake concepts, and Delta Live Tables.
- Advanced level SQL experience including joins, aggregation, and RDBMS schema design.
Preferred:
- Experience with ETL and ELT tools such as SSIS, Pentaho, and Data Migration Services.
- Familiarity with CI/CD pipelines, containerization, and orchestration tools like Airflow.
- Experience with AWS services including Lambda, DynamoDB, and S3.
- Knowledge of Python for CI/CD pipelines and familiarity with testing frameworks like Pytest.
Benefits
- Competitive compensation with a salary range of $103k–$155k.
- Employee Stock Ownership Program (ESOP).
- FlexPTO and learning and development opportunities.
Pyramid Systems, Inc.
Pyramid Systems, Inc. (Pyramid) is an award winning, employee owned (ESOP) business that has provided full-service technology consulting and software engineering solutions for three decades. We leverage leading-edge cloud and low-code platforms with advanced analytics to deliver the security, reliability, and flexible change management required for mission-critical systems. We design and deliver impactful technology-based solutions through a proven technical framework built on tailored Agile methodologies, DevSecOps best practices, and innovative Human-Centered Design. Our approach ensures that if you can envision it, we can engineer it, transforming your toughest challenges into breakthrough opportunities.
Fairfax, VA