Sr. Backend Engineer, Enterprise

Xai · Japan · Engineering

Posted 2026-11-07

Apply for this role →

BACKEND ENGINEER, ENTERPRISE

The Enterprise Agents Engineering Team at SpaceXSI is a team of builders solving the hardest problems in applied AI: integrating with messy systems, orchestrating complex workflows, and harnessing AI to transform business operations. We build full-stack solutions with ownership of end-to-end product execution from ideation to deployment, collaborating closely with our team to incorporate cutting-edge AI advancements into robust and reliable user-centric solutions. Through an iterative development process, we work hand-in-hand with customers to gather feedback, refine features, and evolve products to address real-world challenges.

RESPONSIBILITIES:

Build and maintain the unified inference stack as the single surface area for all inference needs across the company

Own and evolve the platform services that power Chat API, Imagine API, Voice API, Grok Build, and Grok Bot

Design, build, and maintain Chat API features including batch API, collections API, files API, and related capabilities

Implement and operate chat moderation and abuse protection systems across the API and grok.com

Build and maintain the company-wide logging system for all request types, including enforcement of Zero Data Retention (ZDR) policies

Manage multi-region inference cluster (IC) deployments, data aggregation, data replication, and the distributed authentication system

Participate in follow-the-sun on-call coverage (UK → Japan → US) to ensure continuous reliability of the inference platform

BASIC QUALIFICATIONS:

5+ years of experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems

Experience with Rust or C++

PREFERRED SKILLS AND EXPERIENCE:

Experience with operating databases such as PostgreSQL, ClickHouse, and CockroachDB

Knowledge of service observability and reliability best practices

Expert knowledge of Python

Expert knowledge of TypeScript

Experience with Docker, Kubernetes, and containerized applications

Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping)

Hands-on experience with LLM APIs, embeddings, or RAG patterns

Track record of delivering user-facing software at scale

Apply for this role →

← Back to all jobs