7h ago
Staff Data Platform Engineer
London, UK
β¨ $225k-$275k / yearest.- AI estimated, actual pay may differ
full-timelead Hybrid
π Tech Stack
πΌ About This Role
You'll own and lead the Data Transfer Hub, a globally distributed ingestion system for petabyte-scale sensor data enabling Wayve's Embodied AI model training. You'll work directly with partners like Uber and Nissan to build infrastructure that handles up to PB/day of video, LiDAR, and sensor data.
π― What You'll Do
- Set technical direction for the Data Transfer Hub, balancing reliability, throughput, and cost.
- Design and build parallelised, distributed data transfer pipelines using Flyte, Kafka, and Azure.
- Operate a globally distributed hub-and-spoke model for sensor data ingestion and sharing.
- Write infrastructure-as-code in Terraform and pipeline code in Python.
π Requirements
- PB-scale data transfer pipeline experience (building and operating).
- Flyte or equivalent workflow orchestration (Airflow, Prefect) experience.
- Azure cloud platform skills (primary); cross-cloud (AWS/GCP) advantage.
- Python and Terraform proficiency.
β¨ Nice to Have
- Experience with Kafka for event-driven transfer observability.
- Multi-cloud experience across Azure, AWS, and/or GCP.
- Background in autonomous vehicles, robotics, or data-intensive domains.
π Benefits & Perks
- πΊοΈ Global impact - work with OEMs like Uber and Nissan.
- π Startup within a scale-up - high autonomy and ownership.
- π» Hybrid working model - blend office and remote.
- β° Core working hours - flexible schedule.
- π Inclusive culture - accommodations available.
π¨ Hiring Process
Estimated timeline: 2-4 weeks Β· AI estimate
- 1Recruiter CallΒ· 30 min
- 2Technical InterviewΒ· 60 min
- 3Hiring ManagerΒ· 45 min
π© Heads Up
- Requirements may be extremely high for a lead role (PB-scale, multiple cloud providers).
- Fast-changing environment with ambiguity could be stressful.
- No explicit salary mentioned in posting.
This description was AI-summarized. View original
0 0 0