Tech Stack

Description

As a Lead Data Engineer, you will build modern data platform solutions that turn data into actionable insights, reporting, and AI-enabled capabilities to personalize customer experiences. You will lead the design of data pipelines using Snowflake, Databricks, and Azure Data Factory, and collaborate with analytics and data science teams to support AI/ML use cases.

Requirements

• Bachelor’s degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics, Engineering, or another technically strong program.
• 5+ years proven ability of professional data engineering or data development experience.
• Strong understanding of Agile Principles (Scrum).
• 5+ years proven ability developing with SQL.
• Full understanding of ETL/ELT concepts and data warehousing concepts.
• 3+ years developing experience with Python, Scala, or Java.
• Hands-on experience with Snowflake, Databricks, and Azure Data Factory (ADF).

Responsibilities

• Take ownership of features and drive them to completion through all phases of the SDLC.
• Lead design of data platform and SQL-based solutions.
• Perform development of data pipelines, transformations, and orchestration workflows.
• Design and implement solutions using Snowflake, Databricks, Azure Data Factory (ADF), SQL, Python, and JSON.
• Support data ingestion, storage, transformation, and distribution.
• Contribute to data platform architecture supporting analytical and operational use cases.
• Execute unit, integration, and data validation testing.
• Collaborate with team members to ensure consistent development practices.
• Partner with analytics and data science teams to support AI/ML and advanced analytics use cases.
• Help establish governed, scalable data foundations for AI-enabled capabilities.
• Contribute to standards for data quality, governance, lineage, and observability.
• Provide mentoring to junior resources.
• Participate in retrospective reviews.
• Participate in estimation for new work and releases.
• Bring new perspectives to problems and be driven to improve yourself and the way things are done.