Tech Stack

Description

You will own data modeling and pipelines for Lyft's Safety and Customer Care team, powering associate and AI agent platforms. Your work ensures reliable data processing, accurate reporting, and efficiency improvements that save millions annually.

Requirements

• 4+ years of experience in data engineering with large-scale distributed systems
• Strong experience with Spark
• Experience with Hadoop ecosystem (S3, DynamoDB, MapReduce, Hive, Presto, etc.)
• Strong scripting skills (Python, Go)
• Proficient in at least one SQL language (MySQL, PostgreSQL, etc.)

Responsibilities

• Owner of core data pipeline, scaling data processing flow
• Evolve data model and schema based on business and engineering needs
• Implement systems for data quality and consistency
• Develop tools for self-service ETL pipeline management
• SQL and MapReduce job tuning for performance