7h ago

Staff Data Platform Engineer

London, UK

✨ $225k-$275k / yearest.- AI estimated, actual pay may differ

full-timelead Hybrid

πŸ›  Tech Stack

πŸ’Ό About This Role

You'll own and lead the Data Transfer Hub, a globally distributed ingestion system for petabyte-scale sensor data enabling Wayve's Embodied AI model training. You'll work directly with partners like Uber and Nissan to build infrastructure that handles up to PB/day of video, LiDAR, and sensor data.

🎯 What You'll Do

  • Set technical direction for the Data Transfer Hub, balancing reliability, throughput, and cost.
  • Design and build parallelised, distributed data transfer pipelines using Flyte, Kafka, and Azure.
  • Operate a globally distributed hub-and-spoke model for sensor data ingestion and sharing.
  • Write infrastructure-as-code in Terraform and pipeline code in Python.

πŸ“‹ Requirements

  • PB-scale data transfer pipeline experience (building and operating).
  • Flyte or equivalent workflow orchestration (Airflow, Prefect) experience.
  • Azure cloud platform skills (primary); cross-cloud (AWS/GCP) advantage.
  • Python and Terraform proficiency.

✨ Nice to Have

  • Experience with Kafka for event-driven transfer observability.
  • Multi-cloud experience across Azure, AWS, and/or GCP.
  • Background in autonomous vehicles, robotics, or data-intensive domains.

🎁 Benefits & Perks

  • πŸ—ΊοΈ Global impact - work with OEMs like Uber and Nissan.
  • πŸš€ Startup within a scale-up - high autonomy and ownership.
  • πŸ’» Hybrid working model - blend office and remote.
  • ⏰ Core working hours - flexible schedule.
  • 🌈 Inclusive culture - accommodations available.

πŸ“¨ Hiring Process

Estimated timeline: 2-4 weeks Β· AI estimate

  1. 1Recruiter CallΒ· 30 min
  2. 2Technical InterviewΒ· 60 min
  3. 3Hiring ManagerΒ· 45 min

🚩 Heads Up

  • Requirements may be extremely high for a lead role (PB-scale, multiple cloud providers).
  • Fast-changing environment with ambiguity could be stressful.
  • No explicit salary mentioned in posting.

This description was AI-summarized. View original

0 0 0