4h ago

Senior Data Engineer

Barcelona, Spain
full-timeseniormobile app monetization

Tech Stack

Description

You will design and build scalable data pipelines using the Databricks platform (Apache Spark, Delta Lake) and OLAP engines like ClickHouse/Druid for real-time analytics. You'll manage data architecture, optimize performance, and collaborate closely with product, MLOps, and data science teams to empower ML practitioners.

Requirements

  • 3-5+ years professional experience in data engineering
  • Strong expertise in Python and data frameworks (Pandas, PySpark)
  • Experience with modern data storage (Delta tables, data warehouses) and orchestration tools (Dagster, Airflow)
  • Experience with streaming technologies (Kafka, Spark structured streaming) and cloud platforms (AWS S3, EC2)
  • Hands-on experience with ClickHouse and/or Apache Druid

Responsibilities

  • Design and build scalable ETL/ELT pipelines using Databricks (Apache Spark, Delta Lake, Delta Live Tables) for batch and streaming data ingestion
  • Define and maintain scalable data platform architecture integrating Databricks with OLAP engines (ClickHouse/Druid)
  • Design, develop, test, and orchestrate data workflows
  • Optimize performance and reliability of data workflows and databases (Spark, ClickHouse, Druid)
  • Develop internal tools for automating data processes and workflows
0 views 0 saves 0 applications