Software Engineer - Compiler

What MatX Is Building

MatX is building the world's best chips for training and serving large language models, spanning the entire stack — from silicon and rack design through compilers and kernels to ML models. Our systems deliver best-in-class latency, throughput per dollar, and throughput per watt.

We are hiring middle-end and backend-focused compiler engineers. We're looking for compiler engineers with deep expertise and a strong grasp of low-level optimization. ML experience is a plus. If you've worked on LLVM/MLIR, SIMD, NVPTX, or XLA, we'd love to hear from you.

Join us to shape the future of AI hardware abstraction and optimization!

What You'll Do Here

• Design and implement toolchains, primarily in the Rust programming language, tailored for our proprietary hardware architecture that compile Python eDSL into executables.
• Collaborate with AI researchers and hardware architects, offering a compiler author’s perspective on achieving roofline proprietary hardware performance for high-level models.
• Focus on mid-end and backend program analysis, optimization, instruction selection, scheduling, and register allocation passes.

Who You Are

• Bachelor of Computer Science or equivalent degree.
• Possess outstanding software engineering skills with a focus on efficiency and performance.
• Possess experience in compiler algorithms, demonstrating proficiency in areas such as data flow analysis, register allocation, instruction scheduling, instruction selection, and loop optimizations.
• This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday.

Bonus Points If You Have

• Familiarity with ML models and optimization such as Transformers, SIMD programming, or GPU kernels.
• Excellent ability to deal with a dynamic environment, anticipate changes both upstream and downstream of mid-level optimizer, and be willing to make those changes.
• Interest in building tools, languages, C or assembly-level optimization, Rust maintenance, and library development.

Compensation

The US base salary for this full-time position is determined based on a variety of factors, including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.

Early Career - $120,000 - $275,000 + equity

Mid Career - $175,000 - $400,000 + equity

Senior Career - $250,000 - $600,000 + equity

What We Offer

• A Stake in our success: A flexible cash equity compensation mix that fits your needs.
• Health & Wellness: Company subsidized Health, Dental, Vision, and Life insurance; Pre-tax Health Savings Accounts with generous company contribution (even if you don’t).
• Time To Recharge: 4 weeks paid time off (accrued), 12 company holidays, and 3 weeks remote/flexible work per year.
• Support to Parents: Up to 12 weeks of paid parental leave, regardless of your path to parenthood.
• Learning & Development: $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities.
• Team Connection: Team Lunches, quarterly off-sites, and regular town halls.
• Financial Wellbeing: 401K and/or Roth IRA, with 5% company contribution, even if you don’t!
• Flexible Spending Accounts: Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses.
• Commute On Us: For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
• MatX E[x]tras: $50 per month to use on the perks you care about most.
• Remote Perks: We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement.