🛠 Tech Stack

💼 About This Role

You'll build infrastructure for ingestion, transformation, and loading of exponentially increasing data volumes using Spark, SQL, and Databricks. You'll develop CI/CD pipelines and anomaly detection to continuously improve data quality. This role offers high autonomy and opportunity for direct contributions in the data-as-a-service space.

🎯 What You'll Do

• Build ingestion, transformation, and loading pipelines using Spark, SQL, AWS, Databricks
• Develop entity resolution framework for merging billions of entities
• Create CI/CD pipelines and anomaly detection for data quality
• Solve undefined data engineering and data science problems

📋 Requirements

• 5-7+ years of industry experience with technical problem-solving
• Expertise in Apache Spark (Java, Scala, or Python-based)
• Experience with Python and SQL
• Experience with Databricks and AWS (preferred)

✨ Nice to Have

• Degree in quantitative discipline
• Experience with entity data or entity resolution
• Experience with streaming platforms like Kafka

🎁 Benefits & Perks

• 📈 Stock
• 💰 Competitive Salaries
• 🏖️ Unlimited paid time off
• 🏥 Medical, dental, & vision insurance
• 🏋️ Health, fitness, and office stipends