4h ago
Senior Data Engineer
Barcelona, Spain
full-timeseniormobile app monetization
Tech Stack
Description
You will design and build scalable data pipelines using the Databricks platform (Apache Spark, Delta Lake) and OLAP engines like ClickHouse/Druid for real-time analytics. You'll manage data architecture, optimize performance, and collaborate closely with product, MLOps, and data science teams to empower ML practitioners.
Requirements
- 3-5+ years professional experience in data engineering
- Strong expertise in Python and data frameworks (Pandas, PySpark)
- Experience with modern data storage (Delta tables, data warehouses) and orchestration tools (Dagster, Airflow)
- Experience with streaming technologies (Kafka, Spark structured streaming) and cloud platforms (AWS S3, EC2)
- Hands-on experience with ClickHouse and/or Apache Druid
Responsibilities
- Design and build scalable ETL/ELT pipelines using Databricks (Apache Spark, Delta Lake, Delta Live Tables) for batch and streaming data ingestion
- Define and maintain scalable data platform architecture integrating Databricks with OLAP engines (ClickHouse/Druid)
- Design, develop, test, and orchestrate data workflows
- Optimize performance and reliability of data workflows and databases (Spark, ClickHouse, Druid)
- Develop internal tools for automating data processes and workflows
0 views 0 saves 0 applications