8h ago

Director of Software Engineering

Los Angeles, California

$190k-$230k / yearest.

full-timesenior RemoteData Extraction / Web Scraping

🛠 Tech Stack

+7

💼 About This Role

You'll lead the engineering team in designing and optimizing high-performance distributed web scraping systems. You'll oversee data extraction pipelines, anti-bot strategies, and cloud-native architectures for large-scale data collection.

🎯 What You'll Do

  • Architect scalable Node.js web scraping systems
  • Implement anti-bot measures (CAPTCHA, IP rotation)
  • Lead engineering team and technology roadmap
  • Optimize cloud resources and CI/CD pipelines
  • Collaborate with product, DevOps, and data science teams

📋 Requirements

  • 10+ years of software engineering experience
  • 5+ years in web scraping and large-scale data extraction
  • Expertise in Node.js and headless browser automation
  • Strong knowledge of proxy management and anti-bot techniques
  • Experience with cloud deployment (AWS/GCP/Azure) and containerization (Docker/Kubernetes)

✨ Nice to Have

  • Experience with machine learning for data extraction and NLP
  • Familiarity with enterprise-scale crawling frameworks (Scrapy, Colly, Apify)

🎁 Benefits & Perks

  • 🏖️ Remote work flexibility
  • 💰 Competitive salary and equity
  • 🚀 Professional development opportunities

🚩 Heads Up

  • Mismatch: title 'Director' but role includes hands-on web scraping and architecture
0 0 0