21h ago

Engenheiro de Dados Senior

Brazil

โœจ $100k-$130k / yearest.

full-timesenior Hybridconsulting

๐Ÿ›  Tech Stack

๐Ÿ’ผ About This Role

You'll lead migration and modernization of a massive legacy Azure/Databricks system to GCP with a modern data foundation. You'll build scalable data pipelines following Data Mesh and medallion architecture (Raw/Silver/Gold). This role offers exposure to petabytes of data and cutting-edge technologies like BigLake and Gemini.

๐ŸŽฏ What You'll Do

  • Analyze and migrate Spark/Databricks notebooks to GCP
  • Develop ETL/ELT pipelines in BigQuery and Dataform
  • Implement batch and streaming ingestion with Dataflow
  • Provision infrastructure using Terraform and CI/CD

๐Ÿ“‹ Requirements

  • Advanced SQL (preferably BigQuery)
  • GCP experience with BigQuery, GCS, Dataflow, Cloud Composer
  • Python + Apache Spark
  • Experience with Git and CI/CD

โœจ Nice to Have

  • Dataform or DBT
  • Databricks experience
  • Terraform (IaC)

๐ŸŽ Benefits & Perks

  • ๐Ÿš€ High-volume data environment (petabytes)
  • ๐Ÿ› ๏ธ Modern tech stack (BigLake, Analytics Hub, Gemini)
  • ๐Ÿ—๏ธ Data Mesh with well-defined domains

๐Ÿ“จ Hiring Process

Estimated timeline: 2-4 weeks ยท AI estimate

  1. 1Recruiter Screenยท 30 min
  2. 2Technical Interviewยท 60 min
  3. 3Hiring Manager Interviewยท 30 min
0 0 0