🛠 Tech Stack

💼 About This Role

You'll design and optimize data pipelines using Databricks and PySpark in a hybrid cloud environment. Your work will enable scalable analytics solutions for business stakeholders. This role offers opportunities to work with multi-cloud technologies.

🎯 What You'll Do

• Design and implement data pipelines and ETL processes using Databricks and PySpark.
• Develop and optimize SQL queries for data transformation and analytics.
• Collaborate with data architects, analysts, and business stakeholders.
• Troubleshoot and optimize performance for data workflows and queries.

📋 Requirements

• Proven experience with Databricks including Delta Lake and ML capabilities.
• Proficiency in PySpark for distributed data processing.
• Strong SQL skills for data manipulation and analytics.

✨ Nice to Have

• Experience with Azure services like ADF, Synapse, and Purview.
• Familiarity with AWS services like Glue, Lambda, and Step Functions.

🚩 Heads Up

• Job title states Senior but requirements list 'Proven experience' without specific years, typical for mid-level.
• Experience level inferred as senior from title but requirement years not explicitly stated.