Tech Stack

Description

You will architect, design, and implement Airbnb's next-generation big data compute platform to support ETL, analytics, and machine learning. You will manage and operate the platform, enhancing reliability, performance, and cost-efficiency, while contributing to open-source software.

Requirements

• 6+ years of professional experience in data infrastructure, with a deep focus on big data technologies.
• Expert-level knowledge of big data technologies, including Spark, Trino, Kubernetes, and AWS EMR.
• Strong programming abilities in languages such as Java, Scala, and SQL.
• Extensive experience in the design, construction, and maintenance of scalable, fault-tolerant distributed systems.
• Familiarity with a variety of database systems, including both SQL and NoSQL.
• Capacity to diagnose and resolve complex issues within data infrastructure environments.
• Proven track record of working effectively with cross-functional teams to define system requirements, evaluate potential solutions, and manage system testing and integration.
• Excellent written and verbal communication skills.
• Demonstrated ability to thrive and contribute effectively within a team-oriented setting.

Responsibilities

• Architect, design, and implement Airbnb's next-generation big data compute platform to support data ETL, analytics, and machine learning initiatives.
• Manage and operate the platform, continually enhancing its reliability, performance, observability, and cost-efficiency.
• Produce high-quality, maintainable, and self-documenting code, actively participating in code review processes.
• Contribute to open-source software and drive meaningful industry impact.