Tech Stack

Description

You will own Alt's critical data infrastructure, designing and optimizing pipelines that ingest transaction and listing data from dozens of external marketplaces to power real-time pricing and business intelligence. You'll build monitoring systems, modernize storage and processing technologies, and partner with teams to ensure clean, standardized data flows across the platform.

Requirements

• 3-4 years of experience in data engineering or related fields
• Strong Python proficiency with at least 3 years of hands-on experience
• Proven experience with large-scale data processing using dataframe technologies (Pandas, Polars, PySpark, or similar)
• Hands-on experience with pipeline orchestration tools (Airflow, Dagster, or similar DAG-based systems)
• Track record of owning at least one data pipeline end-to-end within the past 2 years
• Solid SQL skills for data analysis and transformation
• Previous startup experience
• A pragmatic mindset focused on delivering value incrementally

Responsibilities

• Design, optimize and own data pipelines that scrape, process and ingest transaction and listing data from major auction houses and marketplaces
• Build comprehensive monitoring and alerting systems to track latency, uptime, and coverage metrics across all data sources
• Continuously improve data infrastructure by modernizing storage and processing technologies, reducing manual interventions, and optimizing for cost, performance, and reliability
• Partner with internal teams to understand data usage patterns and ensure pipelines deliver clean, standardized data that meets product requirements