Member of Technical Staff - ML Performance

THE ROLE:

We are looking for strong engineers with experience in making ML systems performant at scale. If you are interested in contributing to open-source projects and Modal’s container runtime to push language and diffusion models toward higher throughput and lower latency, we’d love to hear from you!

YOU MAY BE A FIT IF:

- You have 5+ years of experience writing high-quality, high-performance code

- You’ve worked with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT)

- You’re familiar with NVIDIA GPU architecture and CUDA

- You have experience with ML performance engineering (tell us a story about boosting GPU performance: debugging SM occupancy issues, rewriting an algorithm to be compute-bound, eliminating host overhead, etc.)

NICE-TO-HAVE:

- Familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc.)