About the Role
About the Role
As a Senior AI Compute Infrastructure Engineer at Kraken, you will be responsible for building and operating GPU and accelerator clusters that support AI workloads. You will work closely with AI/ML researchers and platform engineers to optimize infrastructure for model training, inference, and evaluation, ensuring high performance and cost efficiency.
What You'll Do
- Own and operate GPU and accelerator clusters used for training, inference, evaluation, and experimentation.
- Design infrastructure that enables Kraken teams to run models locally on GPUs.
- Build and improve scheduling, orchestration, placement, quota management, and utilization systems.
- Optimize inference pipelines for latency, throughput, reliability, and cost.
- Partner with ML engineers and researchers to remove bottlenecks in workflows.
- Build observability for GPU utilization and other performance metrics.
- Drive reliability, incident response, and post-incident improvements.
- Evaluate and integrate new hardware and serving frameworks.
- Build tooling for GPU usage visibility and accountability.
- Contribute to long-term architecture decisions.
Who You Are
You bring 5+ years of infrastructure engineering experience, particularly in GPU compute and ML infrastructure. You have hands-on experience operating GPU clusters in production environments and possess strong systems engineering fundamentals.
Requirements
Infrastructure Engineering Experience
5+ years of experience in infrastructure engineering, particularly with GPU compute.
GPU Cluster Operations
Hands-on experience operating GPU clusters or accelerator-backed infrastructure.
Systems Engineering Fundamentals
Strong understanding of systems engineering principles.
Cost Optimization Skills
Experience in cost optimization for compute resources.
Nice to Have
Familiarity with machine learning frameworks and workflows.
Experience with cloud instance families and specialized accelerators.
Benefits
Remote Work Flexibility
Opportunity to work remotely.
Health Insurance
Comprehensive health insurance coverage.
Learning Budget
Budget for professional development and learning.