Tech Stack

Description

You will own the architecture and delivery of Instacart's open lakehouse foundation, data governance, and multi-engine compute strategy. You'll collaborate with engineering leadership and stakeholders to balance reliability, scale, and cost efficiency, shaping the backbone of the data platform.

Requirements

• 5+ years software engineering in data infrastructure or distributed systems at production scale
• Hands-on with lakehouse architectures and open table formats (e.g., Apache Iceberg, Delta Lake)
• Experience with distributed query/compute engines (e.g., Trino, Spark, ClickHouse)
• Experience with event-driven and streaming infrastructure (e.g., Kafka, Flink)
• Proven ownership of major platform transitions or migrations

Responsibilities

• Translate data strategy into multi-year architecture roadmap
• Own open lakehouse foundation: unified table formats, storage governance, multi-engine compute
• Drive real-time and streaming infrastructure for Ads, Fraud, ML
• Pioneer AI-native data infrastructure engineering using LLM/AI tools
• Elevate engineering excellence: lead reviews, mentor engineers, communicate trade-offs