21h ago

Senior Data Engineer - Data Platform

Porto

$39.5k-$62.1k / year

full-timesenior Remotehealthcare

🛠 Tech Stack

💼 About This Role

You'll spearhead the migration of workloads to Apache Iceberg and architect a scalable lakehouse. You'll build Spark/Flink pipelines and develop a Jobs API with data contracts. This role offers the chance to shape the data foundation for an AI-first healthcare platform.

🎯 What You'll Do

  • Migrate existing workloads to Apache Iceberg format
  • Build batch and streaming pipelines with Spark and Flink
  • Collaborate on API integrations and data contracts
  • Contribute to lineage and governance framework with DataHub

📋 Requirements

  • Proficiency in Python and PySpark
  • Experience with Iceberg, Delta Lake, or Hudi
  • Solid understanding of Kafka and event-driven architectures
  • Experience building data pipelines at scale

✨ Nice to Have

  • Expertise with Flink or comparable streaming frameworks
  • Proficiency in dbt and modern data stack
  • Experience with BigQuery, Trino, Snowflake, or Databricks

🎁 Benefits & Perks

  • 💻 Remote or Hybrid work policy
  • 🏖️ Unlimited vacation
  • 💪 Health and well-being program with digital therapist sessions
  • 📈 Career development and competitive salary
  • Stimulating fast-paced environment
0 0 0