Tech Stack

Description

You will drive day-to-day operations by designing and maintaining robust data pipelines, ensuring real-time data availability for analysts. As part of a small team, you will scale BI infrastructure, enforce data governance, and collaborate with stakeholders to deliver reliable data solutions.

Requirements

• 5+ years experience as a Data Engineer, ideally in regulated financial services
• Expert in designing data pipelines with Apache Spark, Hadoop ecosystem
• Strong background in cloud infrastructure (AWS) and hands-on experience with data lakes and modern data warehouses
• Proven programming experience with Scala and Python
• Working knowledge of DBT and Tableau or similar BI tools

Responsibilities

• Manage and scale BI data infrastructure by developing and maintaining data pipelines
• Model data using data lake/warehouse concepts and optimize performance (partitioning, file formats, tuning)
• Implement least-privilege IAM, encryption, data classification, PII handling, and auditability
• Conduct data analysis experiments and provide bespoke solutions to stakeholders
• Collaborate with analysts and domain stakeholders to translate requirements into robust data solutions