About the Role

The RL infrastructure team is looking for an engineer to help with low precision RL training and inference.

Responsibilities

Design and optimize our inference stack for all shapes of RL workloads at SpaceXAI, from small scale ablations to production training runs.
Analyze, profile and address performance bottlenecks in large scale RL systems.
Work closely with the modelling team to efficiently implement novel RL techniques and algorithms.

Basic Qualifications

Experience in building, debugging, and optimizing efficiency of large-scale distributed systems.
Experience in LLM inference.
Proficiency in programming languages such as Python, C++ and/or Rust; frameworks such as PyTorch, Jax, CUDA.
Willingness to dive deep and solve hardcore problems at all levels of the stack.

Preferred Skills and Experience

Strong knowledge in quantization and numerics in LLM inference and training.
Experience in developing inference engines, e.g. SGLang, vLLM.

Compensation and Benefits

Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Requirements

Distributed systems

Experience in building, debugging, and optimizing efficiency of large-scale distributed systems.

LLM inference

Experience in LLM inference is essential.

Programming proficiency

Proficiency in programming languages such as Python, C++ and/or Rust is required.

Problem-solving skills

Willingness to dive deep and solve hardcore problems at all levels of the stack.

Nice to Have

Quantization knowledge

Strong knowledge in quantization and numerics in LLM inference and training is preferred.

Inference engine experience

Experience in developing inference engines, e.g. SGLang, vLLM is a plus.

Benefits

Equity

Employees receive equity as part of the compensation package.

Medical coverage

Comprehensive medical, vision, and dental coverage is provided.

Retirement plan

Access to a 401(k) retirement plan is included.

Disability insurance

Short & long-term disability insurance is part of the benefits.

Life insurance

Life insurance coverage is offered.