Tech Stack

Description

You will build and optimize scalable data pipelines using Python, SQL, and big data technologies like Spark, Hive, Presto, and Kafka. Leverage AI coding tools to accelerate development, ensuring high-quality, production-grade code that powers analytics and AI-driven product features.

Requirements

• 4–7 years of data engineering experience
• Strong skills in Python and SQL
• Hands-on experience with big-data systems (Spark/Hive/Presto/Kafka)
• Understanding of AI-native software development practices
• Proven ability to adopt and drive modern engineering paradigms
• Use AI coding tools (Copilot, ChatGPT, Cursor, etc.) for writing/refactoring pipeline code, SQL generation, debugging, and understanding schemas

Responsibilities

• Write production-grade code in Java or Python
• Design and optimize high-performance SQL on large datasets
• Work with Spark, Hive, Presto, Kafka, or similar technologies
• Leverage generative AI and AI coding tools to accelerate developer productivity
• Build data consumed by analytics and AI-powered product features
• Partner with Data Science, Backend, and Platform teams
• Work on AWS-based data infrastructure (S3, EMR, Redshift, EC2)