🛠 Tech Stack

💼 About This Role

You'll lead the technical evolution of the Databricks Lakehouse, owning architecture, scaling, and reliability of data products for retail analytics. Your impact will ensure high-quality, actionable data moves from ingestion to consumption with operational excellence. This role balances advanced systems design with hands-on rigor.

🎯 What You'll Do

• Own end-to-end architecture and optimization of the Databricks Lakehouse.
• Drive multi-tenant ingestion strategies from Azure Table Storage, Cosmos DB, and APIs.
• Lead evolution of in-house PySpark-based ETL frameworks for complex transformations.
• Partner with BI, Data Science, and Product teams to bridge business requirements.

📋 Requirements

• 8+ years in Data Engineering and 3+ years in a leadership/management role.
• Expert in Workflows, Unity Catalog, and Delta Lake.
• Deep proficiency in PySpark, SQL, and Azure Data ecosystem (Storage, Cosmos DB).
• Proven experience managing multi-tenant or enterprise-scale platforms.

✨ Nice to Have

• Experience with retail or supply chain data forecasting.
• Expertise in optimizing serverless compute environments.
• Experience maintaining production SLAs for customer-facing data dependencies.

🎁 Benefits & Perks

• 🏖️ Unlimited PTO
• 💰 Competitive salary
• 📈 Stock options
• 🏥 Health insurance
• 🏠 Remote flexibility