Tech Stack

Description

You will be responsible for streamlining and tuning existing Big Data systems and pipelines, building new ones, and ensuring systems run efficiently with minimal cost. You will also support internal customers and on-call services, contributing to open source when possible.

Requirements

• 10+ years production experience building big data platforms with Spark, Trino or equivalent
• Strong programming expertise in Java, Scala, Kotlin or another JVM language
• Strong grasp of distributed systems concepts, algorithms, and data structures
• Experience with at least 3 of: Hadoop, Kafka, Spark, Trino, Flink, Airflow, Druid, Hive, Iceberg, Delta Lake, Pinot, Storm
• Extensive hands-on experience with public cloud AWS or GCP

Responsibilities

• Streamline and tune existing Big Data systems and pipelines
• Build new Big Data systems and pipelines
• Ensure systems run efficiently with minimal cost
• Contribute to open source when possible
• Support internal customers and on-call services for hosted systems