Sr. Model Engineer, Mid-Training

Xai · Palo Alto, CA · Engineering

Posted 2026-11-22

Apply for this role →

RESPONSIBILITIES:

Scale synthetic coding data to trillions of tokens with large-scale docker verification

Distill the intelligence of flagship models into flash models through synthetic data generation

Optimize mid-training data mixtures to boost the ceiling for RL

Engineer long-context data recipes

Develop robust and diverse evaluation for mid-training checkpoints

BASIC QUALIFICATIONS:

Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++

Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)

PREFERRED SKILLS AND EXPERIENCE:

Familiarity across all kinds of scaling laws

Strong ability to design ML experiments

Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities

Strong engineering abilities in large-scale data processing frameworks

Experience with ML and large model scaling

Experience with Spark, Ray, and other large-scale data processing frameworks

COMPENSATION AND BENEFITS:

$220,000 - $357,000 USD

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Apply for this role →

← Back to all jobs