About the Role
About the team and the role:
Join the team that builds and operates our core streaming and messaging infrastructure—technology that underpins mission-critical, high-scale applications across the company. You will help design and develop our streaming lakehouse storage system while supporting the reliability and performance of platforms used across our client. This role combines engineering and operational ownership and collaborates with global teammates to deliver resilient, scalable distributed systems.
What you will accomplish:
- Build, operate, and continuously improve the messaging and streaming platforms to ensure reliability, scalability, and high performance.
- Design and develop the streaming lakehouse storage system that supports large-scale data processing and analytics.
- Reduce downtime by proactively identifying, troubleshooting, and resolving production issues.
- Strengthen observability through improved monitoring, logging, and alerting systems.
- Collaborate with global engineering partners to deliver resilient distributed systems.
- Grow expertise in advanced streaming, storage, and distributed system technologies.
What you will bring:
- Strong foundation in computer science, including algorithms, operating systems, networking, and databases.
- Proficiency in at least one programming language: Java, Rust, or C++.
- Deep understanding of message middleware (e.g., Kafka, Pulsar, RocketMQ).
- Familiarity with lakehouse table formats such as Apache Iceberg, Apache Paimon, or Apache Fluss.
- Ability to work effectively within a global team environment.
(Nice to have)
- Experience designing and implementing distributed systems.
- Familiarity with storage engines such as RocksDB or LevelDB and database storage internals.
- Contributions to relevant open-source projects.
Requirements
Computer Science Fundamentals
Strong foundation in algorithms, operating systems, networking, and databases.
Programming Proficiency
Proficiency in at least one programming language such as Java, Rust, or C++.
Message Middleware Knowledge
Deep understanding of message middleware like Kafka, Pulsar, or RocketMQ.
Lakehouse Formats Familiarity
Familiarity with lakehouse table formats such as Apache Iceberg or Apache Paimon.
Nice to Have
Experience designing and implementing distributed systems.
Familiarity with storage engines such as RocksDB or LevelDB.
Contributions to relevant open-source projects.