🛠 Tech Stack

💼 About This Role

You'll design and maintain scalable ML/LLM infrastructure and pipelines for Germany's #1 real estate platform. You'll productionize traditional ML and generative AI solutions with cross-functional teams. This role stands out with a focus on LLM Gateway services and MCP integrations for robust, observable, and cost-efficient AI.

🎯 What You'll Do

• Design and maintain scalable ML/LLM infrastructure and pipelines
• Productionize traditional ML and generative AI solutions with cross-functional teams
• Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation, optimization
• Build and evolve an LLM Gateway service to standardize access, routing, and governance

📋 Requirements

• MLOps experience (CI/CD, Docker, Kubernetes) and operating production-grade systems
• Proficiency in Python and solid software engineering skills
• Hands-on experience with LLMs and generative AI (e.g., GPT, Gemini, Anthropic-like models)
• Expertise in prompt engineering and agent orchestration

✨ Nice to Have

• Experience with evaluation frameworks for LLM outputs
• Familiarity with cloud platforms like AWS or GCP
• Knowledge of MCP-compatible services for context exchange

🎁 Benefits & Perks

• 🏖️ 30 vacation days per year
• 💻 Hybrid work model with flexible days
• 📚 Dedicated learning time and ScoutAcademy courses
• 🏋️ On-site gym and rooftop terrace
• 🐶 Dog-friendly office (with approval)

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Interview· 60 min
3. 3System Design Interview· 60 min