About the Role
About The Role
SambaNova is hiring Principal Software Engineers for the SambaStack platform.
We help enterprises and service providers host their own AI inference platforms, powered by our state-of-the-art RDU (Reconfigurable Dataflow Unit) architecture.
Our cloud-agnostic, enterprise-grade inference serving platform enables seamless deployment, management, and scaling of foundation model workloads at production scale.
As a Principal Software Engineer on the SambaStack team, you will:
- Improve performance, scalability, and reliability
- Introduce new features and platform capabilities
- Design and build components for a state-of-the-art inference serving platform
- Drive technical execution across critical infrastructure initiatives
Responsibilities
Some of your responsibilities will include:
- Ensure stability, scalability, and performance of the AI inference platform
- Collaborate with ML, Product Managers, QA, and DevOps teams
- Develop components using Python, Go, and Rust
- Build and improve testing frameworks and automation
- Design and implement systems for new AI inference challenges
- Drive engineering excellence and software quality across the platform
Basic Qualifications
- 8-12 years of software engineering experience
- Experience building backend systems in Python, Go, or Rust
- Strong experience with Unit testing, Integration testing, and End-to-end testing frameworks
- Solid understanding of Kubernetes and Helm Charts
- Strong understanding of distributed systems and experience building scalable, reliable services
- Excellent problem-solving skills and attention to detail
- Ability to collaborate across cross-functional teams
- Knowledge of software development best practices and coding standards
Preferred Qualifications
- Experience with Kubernetes ecosystem, including familiarity with AI inference serving and orchestration
- Experience with AI coding assistants and related technologies
- Knowledge of ML application optimization and productionization
- Ability to design and build cloud-native systems
Requirements
Software Engineering Experience
8-12 years of software engineering experience is required.
Backend Development
Experience building backend systems in Python, Go, or Rust is essential.
Testing Frameworks
Strong experience with unit testing, integration testing, and end-to-end testing frameworks is necessary.
Kubernetes Knowledge
A solid understanding of Kubernetes and Helm Charts is required.
Distributed Systems
Strong understanding of distributed systems and experience building scalable, reliable services is needed.
Nice to Have
Familiarity with AI inference serving and orchestration is a plus.
Experience with AI coding assistants and related technologies is preferred.
Ability to design and build cloud-native systems is advantageous.