🛠 Tech Stack

💼 About This Role

You'll own the complete lifecycle of large language model implementation, from data preparation to production deployment. You'll build low-latency, high-throughput AI/ML systems handling thousands of requests per second. This role offers immediate impact at a fast-growing startup backing products like OpenAI and Midjourney.

🎯 What You'll Do

• Prepare data, fine-tune, evaluate, and deploy LLMs to production.
• Develop automated evaluation frameworks for model accuracy.
• Design low-latency, high-throughput cloud-based AI/ML systems.
• Build model serving, monitoring, and deployment pipelines.

📋 Requirements

• 5-7+ years of engineering experience with LLMs in industry.
• Fluency in Python and AI/ML frameworks (TensorFlow, PyTorch, Keras).
• Experience with RAG architectures, embedding models, and vector databases.
• Hands-on experience with AWS cloud architecture and Terraform.

✨ Nice to Have

• Experience at a high-growth startup building ML infrastructure.
• Experience with agentic frameworks like LangChain.

🎁 Benefits & Perks

• 💰 Competitive salary ($200K – $250K + equity).
• 🏖️ Generous benefits (details not specified).
• 🏢 Hybrid work with office in New York.
• 📈 401k match provided.