11h ago

Staff Software Engineer – Foundational Data Systems for AI

Bay Area Office

$240k-$290k / year

full-timeseniorai-ml

🛠 Tech Stack

💼 About This Role

You'll architect self-optimizing data infrastructure that continuously improves how information is represented and used by AI. Partnering with the Granica Research group, you'll bridge advances in information theory with large-scale distributed systems, driving the next leap in efficient AI infrastructure. This role combines research breakthroughs with production-grade systems to define the future of AI data.

🎯 What You'll Do

  • Define and evolve global metadata and transactional substrate for exabyte-scale data systems
  • Architect self-optimizing systems that compress data based on access patterns
  • Pioneer intelligent data layouts to maximize signal per byte read
  • Lead development of autonomous compute pipelines with predictive scaling

📋 Requirements

  • Mastery of distributed systems: consensus, replication, consistency
  • Proven 10× impact in delivering large-scale data or compute systems
  • Expertise with columnar formats and low-level data representation
  • Deep production experience with Spark, Flink, or next-gen compute frameworks

✨ Nice to Have

  • Familiarity with Iceberg, Delta Lake, or Hudi
  • Published contributions in distributed systems, compression, or data representation
  • Passion for bridging research and production

🎁 Benefits & Perks

  • 💰 Competitive salary with meaningful equity and bonus
  • 🏖️ Flexible time off plus comprehensive health coverage
  • 🔬 Support for research and publication
0 0 0