21h ago
Engenheiro de Dados Senior
Brazil
โจ $100k-$130k / yearest.
full-timesenior Hybridconsulting
๐ Tech Stack
๐ผ About This Role
You'll lead migration and modernization of a massive legacy Azure/Databricks system to GCP with a modern data foundation. You'll build scalable data pipelines following Data Mesh and medallion architecture (Raw/Silver/Gold). This role offers exposure to petabytes of data and cutting-edge technologies like BigLake and Gemini.
๐ฏ What You'll Do
- Analyze and migrate Spark/Databricks notebooks to GCP
- Develop ETL/ELT pipelines in BigQuery and Dataform
- Implement batch and streaming ingestion with Dataflow
- Provision infrastructure using Terraform and CI/CD
๐ Requirements
- Advanced SQL (preferably BigQuery)
- GCP experience with BigQuery, GCS, Dataflow, Cloud Composer
- Python + Apache Spark
- Experience with Git and CI/CD
โจ Nice to Have
- Dataform or DBT
- Databricks experience
- Terraform (IaC)
๐ Benefits & Perks
- ๐ High-volume data environment (petabytes)
- ๐ ๏ธ Modern tech stack (BigLake, Analytics Hub, Gemini)
- ๐๏ธ Data Mesh with well-defined domains
๐จ Hiring Process
Estimated timeline: 2-4 weeks ยท AI estimate
- 1Recruiter Screenยท 30 min
- 2Technical Interviewยท 60 min
- 3Hiring Manager Interviewยท 30 min
0 0 0