5h ago
Lead Data Engineer
Hyderabad
full-timeseniorfinancial technology
Tech Stack
Description
You will work with Product Managers, Subject Matter Experts, Data Scientists and Software Engineers to design, build, and optimize scalable data pipelines for our Data Platform. Your role involves architecting, building, and maintaining data solutions and pipelines to meet business requirements, leading a team of talented technologists, and driving improvements in performance, reliability, and scalability.
Requirements
- Bachelor's degree in computer science, Math, or other technical fields with 6-8 years of experience.
- End-to-end delivery of enterprise-grade software.
- Experience with Data Engineering, Data Lakes, Data Warehousing, Data Pipelines, Data Analytics tools.
- Experience with open-source Big Data technologies such as Spark, Hadoop, Elasticsearch, Kafka.
- Advanced proficiency in Python for building scalable data pipelines and automating workflows.
Responsibilities
- Work closely with product and other teams to understand business requirements and translate them into robust engineering solutions.
- Architect, build and maintain data solutions and pipelines to meet business requirements.
- Engage and lead a team of talented technologists and establish engineering best practices.
- Act as a point of contact for managing and driving production defects and stability improvements to resolution.
- Oversee end-to-end data workflows from ingestion, transformation, and storage to data lake in both batch and streaming environments.
0 views 0 saves 0 applications