🛠 Tech Stack

💼 About This Role

You'll design and build the document processing pipelines that power a leading knowledge management and RAG platform, handling everything from parsing to embedding generation. Your work will directly impact the accuracy and speed of enterprise AI. This is a chance to re-architect a legacy pipeline into a modern, orchestrated system at significant scale.

🎯 What You'll Do

• Design and build pipeline stages for modern ingestion architecture
• Contribute to next-generation pipeline architecture design
• Improve system stability and scale with observability and bottleneck reduction
• Handle diverse document formats through the pipeline
• Collaborate with upstream and downstream teams for clean data flow

📋 Requirements

• 5+ years of software engineering experience
• Strong proficiency in Python and/or Go
• Experience with workflow orchestration tools like Temporal or Airflow
• Understanding of distributed systems patterns such as queues and retry strategies

✨ Nice to Have

• Experience with Kubernetes, Docker, Terraform, Helm
• Familiarity with message brokers like Kafka or RabbitMQ
• Comfort across cloud providers (AWS, Azure, GCP)