1d ago
Senior Python Data Engineer
Illinois
โจ $120k-$160k / yearest.
full-timesenior Remoteai-ml
๐ Tech Stack
๐ผ About This Role
You'll drive specialized data scraping workflows within a hybrid AI + human system, collaborating with agents to deliver accurate datasets. Your work ensures reliable extraction from dynamic web sources for Generative AI applications. This remote role offers hands-on experience at the intersection of AI and real-world data.
๐ฏ What You'll Do
- Own end-to-end data extraction workflows across complex websites.
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows.
- Ensure reliable extraction from dynamic web sources, adapting to changes.
- Enforce data quality standards through validation and systematic verification.
- Scale scraping operations efficiently for large datasets.
๐ Requirements
- 3+ years experience in web scraping or related fields.
- Strong experience in Python web scraping with dynamic content and APIs via proxies.
- Proven ability to extract data from complex structures and clean datasets.
- Hands-on experience with LLMs and AI frameworks for enhancing automation.
โจ Nice to Have
- Bachelor's or Master's in Engineering, Computer Science, or related fields.
- Portfolio or link to GitHub.
๐ Benefits & Perks
- ๐๏ธ Fully remote work on your schedule.
- ๐ค Hands-on experience in hybrid AI+human environment.
- ๐ฐ Performance-based bonus programs for high-quality work.
๐จ Hiring Process
Estimated timeline: 2-3 weeks ยท AI estimate
- 1Recruiter Screenยท 30 min
- 2Technical Interviewยท 60 min
- 3Final Roundยท 45 min
0 0 0