Tech Stack

Description

You will sustain the hybrid cloud production environment for the SOM Center's data ecosystem, acting as the technical interface between Data Science and IT. Your focus is on building an internal developer platform (IDP) that leverages Kubernetes and cloud resources to scale workflow orchestration, knowledge graph pipelines, and distributed model inference.

Requirements

• Experience with Kubernetes, containerization, and cloud environments (GCP/AWS)
• Ability to refactor Jupyter Notebooks and R scripts into robust software packages
• Familiarity with model inference servers (vLLM, Triton Inference Server)
• Experience with workflow orchestration tools (Airflow, Prefect, Dagster)
• Proficiency in AI-assisted coding tools (e.g., GitHub Copilot)

Responsibilities

• Collaborate with IT to define compute requirements and orchestrate workloads on the Kubernetes cluster
• Define Infrastructure as Code (IaC) specifications for application-level resources
• Transform experimental code into containerized software packages and optimize model inference servers
• Deploy and maintain workflow orchestration platform (e.g., Apache Airflow, Prefect, Dagster)
• Administer Data Foundation infrastructure including Graph and Vector Databases