1d ago
Data Automation Engineer
Delhi, India
โจ $70k-$100k / yearest.
full-timemideducation
๐ Tech Stack
๐ผ About This Role
You'll build the automation function from scratch for the University Data Engineering team at Cialfo, owning scrapers, AI workflows, and data pipelines. Your work will directly impact hundreds of thousands of students making university decisions. You'll replace manual data collection with production-grade automation and own the technical stack end-to-end.
๐ฏ What You'll Do
- Build notification classification pipeline for 450 alerts per week.
- Develop signal addressal workflow for 150 signals per week.
- Create automated quality audit agent for nightly accuracy checks.
- Own rankings and key stats ingestion across 4,441 universities.
๐ Requirements
- Python with production-grade scripts ownership.
- REST API integration with rate limits, auth, pagination.
- Web scraping dynamic, JavaScript-rendered, anti-scraper sites.
- Independent ownership of automation or data pipeline.
โจ Nice to Have
- LLM API usage in production for classification or extraction.
- N8N or equivalent workflow automation experience.
- EdTech or university data domain knowledge.
๐ Benefits & Perks
- ๐ Ownership of automation stack from scratch.
- ๐ Global impact on students making university decisions.
- ๐ง Tech stack freedom to choose tools and architecture.
- ๐ค Supportive team with deep domain knowledge.
๐จ Hiring Process
Estimated timeline: 2-4 weeks ยท AI estimate
- 1Recruiter callยท 30 min
- 2Technical interviewยท 60 min
- 3Hiring manager interviewยท 45 min
0 0 0