8h ago
Director of Software Engineering
Los Angeles, California
✨ $190k-$230k / yearest.
full-timesenior RemoteData Extraction / Web Scraping
🛠 Tech Stack
+7
💼 About This Role
You'll lead the engineering team in designing and optimizing high-performance distributed web scraping systems. You'll oversee data extraction pipelines, anti-bot strategies, and cloud-native architectures for large-scale data collection.
🎯 What You'll Do
- Architect scalable Node.js web scraping systems
- Implement anti-bot measures (CAPTCHA, IP rotation)
- Lead engineering team and technology roadmap
- Optimize cloud resources and CI/CD pipelines
- Collaborate with product, DevOps, and data science teams
📋 Requirements
- 10+ years of software engineering experience
- 5+ years in web scraping and large-scale data extraction
- Expertise in Node.js and headless browser automation
- Strong knowledge of proxy management and anti-bot techniques
- Experience with cloud deployment (AWS/GCP/Azure) and containerization (Docker/Kubernetes)
✨ Nice to Have
- Experience with machine learning for data extraction and NLP
- Familiarity with enterprise-scale crawling frameworks (Scrapy, Colly, Apify)
🎁 Benefits & Perks
- 🏖️ Remote work flexibility
- 💰 Competitive salary and equity
- 🚀 Professional development opportunities
🚩 Heads Up
- Mismatch: title 'Director' but role includes hands-on web scraping and architecture
0 0 0