2h ago
Data Engineer - SDE 1
Bengaluru
✨ $1000k-$2000k / yearest.
full-timejuniorfintech
🛠 Tech Stack
💼 About This Role
You'll build a high-performance data lakehouse with sub-minute latency, managing real-time CDC and unified batch/streaming compute. You'll own high-throughput ingestion pipelines using Debezium and PeerDB. You'll optimize query engines like Trino and Clickhouse for real-time dashboards.
🎯 What You'll Do
- Own real-time CDC ingestion from RDBMS to lakehouse using Debezium.
- Design and optimize Iceberg/Delta/Hudi table formats for performance.
- Develop ETL/ELT frameworks in PySpark and Flink for batch/streaming.
- Manage data workloads on AWS (EMR, EKS, MSK, S3) with IaC.
📋 Requirements
- 1–3 years in Data Engineering with distributed systems.
- Expert-level Python/PySpark and SQL.
- Hands-on experience with AWS (S3, EKS, MSK) and IaC.
- Experience with Airflow or Temporal for workflow management.
✨ Nice to Have
- Familiarity with Go/Java/Scala.
- Proficiency in using AI tools (Claude, Codex, Copilot).
- Understanding of domain modelling for OLAP (facts, dimensions, SCDs).
🎁 Benefits & Perks
- 💵 Competitive Salary with equity.
- 🏥 Health Insurance for you and family.
- 📈 Learning Budget for courses and conferences.
- 🏖️ Flexible PTO policy.
0 0 0