Description

You will design, maintain, and optimize large-scale pipelines that ingest data from open-source and social media platforms, enabling real-time signal delivery to customers. Your work ensures that critical safety information is discovered and processed efficiently.

Requirements

• Strong background in social media web scraping and data ingestion
• Experience with production-grade scraping and data engineering
• Proven ability to build and scale data pipelines

Responsibilities

• Design and maintain data pipelines for scraping and ingestion
• Optimize and expand data pipelines for scale
• Own complex systems end to end
• Improve pipeline reliability and performance over time