18h ago
Senior Azure Databricks Engineer
Hyderabad
✨ $152k-$190k / yearest.
full-timesenior Hybridconsulting
🛠 Tech Stack
💼 About This Role
You'll architect and optimize Azure Databricks solutions using Apache Spark and Delta Lake for batch and streaming data. You'll lead development of ETL/ELT pipelines and drive performance tuning and cost optimization. This role allows you to establish best practices and mentor engineers in a hybrid work environment.
🎯 What You'll Do
- Architect and build Azure Databricks solutions using Apache Spark
- Design Lakehouse data models and curation layers with Delta Lake
- Lead end-to-end development of ETL/ELT pipelines
- Optimize Spark workloads and cluster performance
📋 Requirements
- 6+ years of data engineering experience with Azure Databricks
- Expert-level Spark experience (PySpark/Scala) and strong SQL
- Experience building Delta Lake / Lakehouse architectures
- Experience with Azure services like ADLS Gen2, Data Factory, and Event Hubs
✨ Nice to Have
- Databricks certifications (Data Engineer Associate/Professional)
- Experience with Unity Catalog and enterprise governance
- Infrastructure as Code (Terraform/Bicep) experience
🎁 Benefits & Perks
- 🏖️ Unlimited PTO
- 🏥 Health insurance
- 📈 Retirement plan matching
- 💻 Remote work flexibility
- 📚 Professional development budget
0 0 0