🛠 Tech Stack

💼 About This Role

You'll join a lean team building infrastructure to power AI data extraction at global scale. Your core impact will be leading efforts to gather and analyze data while optimizing scraping processes. This role stands out for its unique access to high-quality public web data and the opportunity to shape open web data accessibility.

🎯 What You'll Do

• Write, test, and refine code for extracting data from online sources.
• Handle complexities like pagination and dynamic AJAX-loaded content.
• Clean and format extracted data for quality standards.
• Store and manage scraped data in databases, optimizing speed and integrity.

📋 Requirements

• Python or JavaScript proficiency with libraries like BeautifulSoup, Scrapy, or Selenium.
• Asynchronous programming and multithreading for distributed scraping.
• In-depth knowledge of HTML, CSS, JavaScript, and the DOM.
• Experience with NoSQL databases like MongoDB or Cassandra.

✨ Nice to Have

• Machine learning algorithms for data cleaning or categorization.
• Cloud services (AWS, GCP, Azure) for deploying scraping jobs at scale.
• Open-source contributions related to web scraping or data processing.

🎁 Benefits & Perks

• 💼 Competitive salary and equity package.
• 🏖️ Flexible remote work culture.
• 🚀 Opportunity to work on cutting-edge AI infrastructure.

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Interview· 60 min
3. 3Take-home Assessment· 2-3 hours