9h ago

Senior Data Engineer

Tallinn, Spain (Remote)

$150k-$200k / yearest.

full-timesenior Remoteidentity verification

🛠 Tech Stack

💼 About This Role

You'll own and evolve the data lake and data warehouse infrastructure at Veriff, driving platform-level data governance and reliability at scale. You'll ensure Veriffians have access to accurate and timely data for ML, analytics, and reporting.

🎯 What You'll Do

  • Own and evolve data lake and warehouse infrastructure using Spark, Iceberg, S3, Trino/Athena, Redshift.
  • Design and maintain platform-level data transformation pipelines in Python and SQL.
  • Implement optimized storage formats and partitioning strategies for query performance.
  • Drive data governance initiatives including PII detection, access control, and data quality.

📋 Requirements

  • Strong experience with Python, SQL, and Apache Spark for large-scale data processing.
  • Deep knowledge of modern analytics platform architecture including object stores and columnar formats.
  • Experience with data governance and data management at scale.
  • Experience designing and operating data lake and data warehouse infrastructure.

✨ Nice to Have

  • Experience with Infrastructure as Code (IaC) and Terraform.
  • Familiarity with containerization and CI/CD pipelines.
  • Knowledge of data lake table formats beyond Iceberg.

🎁 Benefits & Perks

  • 🏠 Flexibility to work from home
  • 📈 Stock options
  • 🏖️ Extra recharge days on top of annual vacation
  • 🏥 Extensive medical, dental, and vision insurance
  • 📚 Learning and Development and Health budget
0 0 0