About the Role

As an ideal candidate you have a good understanding of how highly scalable and reliable production infrastructure is built. Most of our backend infrastructure is written in Rust. So familiarity with a compiled language such as C++, Rust, or Go is highly beneficial.

Responsibilities

Build the SpaceXAI API that serves our models to developers worldwide.
Own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling.

Basic Qualifications

Expert knowledge of either Rust or C++.
Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems.
Knowledge of service observability and reliability best practices.
Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB.

Preferred Skills and Experience

Experience with LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM).
Experience designing or building with agent SDKs and agent orchestration frameworks.
Experience with Docker, Kubernetes, and containerized applications.
Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping).

Compensation and Benefits

Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive healthcare and dental coverage, cash plan, income protection, life insurance, and various other discounts and perks.

Requirements

Rust or C++ expertise

Expert knowledge of either Rust or C++ is required.

Distributed systems experience

Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems.

Database management

Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB.

Service observability knowledge

Knowledge of service observability and reliability best practices.

Nice to Have

LLM inference experience

Experience with LLM inference engines and serving frameworks.

Containerization skills

Experience with Docker, Kubernetes, and containerized applications.

gRPC expertise

Expert knowledge of gRPC including various streaming methods.

Benefits

Equity

Employees receive equity as part of the compensation package.

Healthcare coverage

Comprehensive healthcare and dental coverage is provided.

Income protection

Income protection insurance is included in the benefits.

Life insurance

Life insurance is part of the total rewards package.