12h ago

C++ Systems Engineer

New York City

$175k-$275k / year

full-timemidai-ml

๐Ÿ›  Tech Stack

๐Ÿ’ผ About This Role

You'll design and optimize the core native runtime for LM Studio, working across LLM engines and GPU backends. You'll implement system-level code for concurrency, memory, and IPC, and integrate platform acceleration paths like Metal and CUDA. This role offers the chance to shape the future of on-device AI software.

๐ŸŽฏ What You'll Do

  • Contribute to the C++ runtime powering LM Studio
  • Extend LLM engine integrations for desktop OS
  • Implement resilient IPC and scheduling logic
  • Improve build, packaging, and release infrastructure

๐Ÿ“‹ Requirements

  • 4+ years building production C++ systems software
  • Deep knowledge of concurrency and memory management
  • C++11 (or newer) expertise with RAII mindset
  • Experience optimizing performance with profilers

โœจ Nice to Have

  • Experience with GPU backends (Metal, CUDA, Vulkan)
  • Familiarity with llama.cpp or MLX
  • Cross-platform development (macOS, Windows, Linux)

๐ŸŽ Benefits & Perks

  • ๐Ÿ’ฐ Competitive salary with equity
  • ๐Ÿ™๏ธ New York City based, in-person collaboration
  • ๐Ÿง‘โ€๐Ÿ’ป Small team with direct impact
  • ๐Ÿš€ Cutting-edge AI products

๐Ÿ“จ Hiring Process

Estimated timeline: 2-3 weeks ยท AI estimate

  1. 1Recruiter Screenยท 30 min
  2. 2Technical Interviewยท 60 min
  3. 3Onsite Interviewยท half day
0 0 0