2h ago

Senior Software Engineer - Python and Data Ecosystem

UK
full-timesenior Remotedata infrastructure / real-time analytics

Tech Stack

Description

You will own and evolve ClickHouse's Python connector and SDK ecosystem, building and maintaining integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt). You will drive the AI/LLM integration strategy, designing connectors for RAG architectures and ML pipelines, and engage with the open-source community to shape the roadmap based on real-world feedback.

Requirements

  • 7+ years of software development experience, ideally as Data Engineer, Data Scientist, or ML Engineer
  • Deep experience designing and maintaining production-grade Python connectors, SDKs, or integrations for major platforms
  • Solid experience with Python data ecosystem: Pandas, NumPy, Pydantic
  • Prior contributions to or deep practical experience with data orchestration tools (Airflow, Dagster, or Prefect)
  • Hands-on experience with AI/ML in data engineering: embedding generation, vector search, feature pipelines, or LLM-powered tooling

Responsibilities

  • Own and evolve ClickHouse's Python connector and SDK ecosystem
  • Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt)
  • Drive AI/LLM integration strategy: design connectors for RAG, ML feature pipelines, and LLM-powered data applications
  • Engage actively with the open-source community: triage issues, support contributors, advocate for users
  • Collaborate with Product, Cloud, and other engineering teams to align integration work with platform priorities
0 views 0 saves 0 applications