Tech Stack

Description

You will design, build, and optimize scalable data pipelines and analytics solutions using Microsoft Fabric and PySpark. You'll work on Lakehouse architecture, data integration, and large-scale data processing to support enterprise analytics and reporting.

Requirements

• 6-8 years of experience in data engineering
• Strong hands-on experience with Microsoft Fabric (Lakehouse, Data Factory, Data Warehouse, Notebooks)
• Expertise in PySpark and Spark-based data processing
• Strong programming skills in Python
• Advanced knowledge of SQL and database optimization

Responsibilities

• Design, develop, and maintain data pipelines and ETL/ELT processes using Microsoft Fabric and PySpark
• Build and manage Lakehouse and Data Warehouse solutions within Microsoft Fabric
• Develop scalable data processing workflows using Python and PySpark
• Write optimized SQL queries for data transformation, analysis, and performance tuning
• Integrate data from APIs, databases, cloud storage, and streaming platforms