14h ago
Senior Data Engineer
Brazil
โจ $90k-$120k / yearest.
full-timesenior Remotesoftware
๐ Tech Stack
๐ผ About This Role
You'll design and implement scalable data pipelines using Databricks and Microsoft Fabric for a global organization. Your work will enable high-quality data for AI and LLM components, driving impactful analytics. This remote role offers the chance to shape our data architecture from the ground up.
๐ฏ What You'll Do
- Design and implement scalable data pipelines using Databricks and Microsoft Fabric.
- Build and maintain Medallion Architecture (Bronze, Silver, Gold layers).
- Collaborate with AI team to ensure data availability for RAG patterns and LLMs.
- Develop and optimize data models for Microsoft Power Platform.
๐ Requirements
- Databricks experience with Spark, Delta Lake, and workspace management.
- Microsoft Fabric knowledge: navigating and implementing Fabric ecosystem solutions.
- Medallion Architecture experience implementing Bronze, Silver, Gold layers.
- Python (PySpark) and SQL proficiency for data transformation and engineering.
โจ Nice to Have
- Azure platform and Azure Data Factory experience.
- Familiarity with Vector Databases (e.g., ChromaDB) for LLM support.
- Power BI and Power Apps data preparation experience.
๐ Benefits & Perks
- ๐๏ธ Remote Work
- ๐ป Flexible Schedule
- ๐ Professional Development Budget
- ๐ฅ Health Insurance
๐จ Hiring Process
Estimated timeline: 2-3 weeks ยท AI estimate
- 1Recruiter Callยท 30 min
- 2Technical Interviewยท 60 min
- 3Hiring Manager Interviewยท 45 min
0 0 0