Tech Stack

Description

You will design, build, and manage scalable data pipelines and infrastructure using technologies like Informatica, Airflow, Databricks, and Google BigQuery. Collaborate with data scientists and analysts to deliver high-quality data for analytics and business intelligence initiatives.

Requirements

• Bachelor's degree in Computer Science or related technical field
• 5+ years of experience in data engineering
• Strong SQL proficiency and extensive Google BigQuery experience
• Hands-on experience with Databricks and Dataproc
• Proficiency in Python and experience with Airflow and Informatica

Responsibilities

• Design and build robust ETL/ELT pipelines using Informatica, Airflow, and Dataproc
• Develop and manage data warehouse on Google BigQuery
• Process large volumes of data using Databricks and Python
• Implement CI/CD pipelines for data workflows using Dataform and GitHub
• Collaborate with data scientists and analysts to understand data needs