Tech Stack

Description

You will design, implement, and maintain scalable data pipelines using tools like Apache Airflow, Spark, and AWS. You'll ensure data quality, governance, and accessibility across the organization, collaborating with cross-functional teams to drive informed decision-making.

Requirements

• 6+ years managing data infrastructure and optimizing pipelines at scale
• 5+ years hands-on with Apache Airflow, Iceberg, AWS (S3, Lambda, Redshift, Glue, Athena)
• 5+ years experience with Trino/Presto and Apache Spark
• Solid understanding of data modeling, warehousing, and schema design
• Ability to communicate complex data concepts to technical and non-technical stakeholders

Responsibilities

• Design, implement, and maintain scalable data pipelines
• Implement data governance policies for accuracy, consistency, and compliance
• Build, optimize, and maintain ETL pipelines
• Manage workflows using Apache Airflow
• Optimize data infrastructure using AWS, Airflow, and Iceberg