Site Reliability Engineer - Data Center

About the Role

As a Site Reliability Engineer focused on Hardware, you will serve as an expert focused on firmware, hardware specifications, vendor relations, and failure analysis. You will proactively identify and resolve hardware issues, manage RMA processes, and stay ahead of emerging hardware technologies to support SpaceXAI's data center operations. This role demands deep technical expertise in hardware diagnostics, and forward-looking hardware evaluation.

Responsibilities

• Analyze firmware packages and hardware specifications for upcoming releases for compatibility, performance, and reliability in SpaceXAI's data center environment.
• Run security scanning and CVE / vulnerability analysis on firmware and related components.
• Flag safety issues (electrical, thermal, power-protection, fail-safe behavior) before the package hits the floor.
• Investigate and diagnose hardware failures, including "grey failures" (ambiguous or intermittent issues), proving them as true hardware defects through rigorous testing and data analysis.
• Manage vendor relationships, including initiating RMA (Return Merchandise Authorization) claims, negotiating beyond standard processes when necessary, and holding vendors accountable for resolutions.
• Collaborate with Data Center Operations Technicians to troubleshoot, repair, and optimize hardware systems in real-time.
• Develop and implement monitoring tools, scripts, and processes to detect hardware anomalies early and minimize downtime.
• Document failure modes, RCAs, AFR / reliability models, RMA outcomes, and hardware evaluations into a team knowledge base.
• Participate in on-call rotations and incident response for hardware-related issues in the Memphis data center.

Basic Qualifications

• Bachelor's degree in Systems Engineering, Electrical Engineering, Computer Science, or a related field (or equivalent experience).
• 2+ years of experience in hardware reliability engineering, preferably in high-performance computing or data center environments.
• Proven expertise in firmware analysis, hardware specifications review, and release validation.
• Strong experience with RMA processes, including filing claims, vendor negotiations, and pushing for resolutions outside standard protocols.
• Demonstrated ability to diagnose and prove complex hardware failures, including grey or intermittent issues, using tools, logic analyzers, or diagnostic software.
• Familiarity with data center hardware components (e.g., servers, GPUs, networking equipment) and emerging technologies.
• Proficiency in scripting (Python, Bash) for automation and analysis, plus general experience in at least one systems language (C, C++, Java, Rust, or similar).
• Excellent problem-solving skills with a data-driven approach to reliability engineering.
• Ability to work collaboratively with cross-functional teams, including operations technicians.

Preferred Skills and Experience

• Experience in AI/ML infrastructure or supercomputing environments.
• Knowledge of vendor ecosystems (e.g., NVIDIA, Dell, HP, Supermicro) and supply chain management.
• Certifications in hardware engineering or reliability (e.g., CRE, CompTIA Server+).
• Prior work in a fast-paced startup or tech environment.