About the Role
Develop high-performance data processing pipelines. Experience with Apache Arrow and DataFusion is required. As a Senior Data Engineer, you will build the foundation of our real-time data analytics platform. You will design and implement efficient data ingestion, transformation, and query engines using Rust and the Arrow ecosystem, enabling our customers to gain insights from their data faster than ever.
Requirements
Strong proficiency in Rust
Experience with Apache Arrow, DataFusion, or Polars
Knowledge of data engineering patterns and distributed processing
Proficiency in SQL and query optimization
Experience with cloud data warehouses and streaming platforms
Nice to Have
Contributions to the Arrow or DataFusion projects
Experience with Parquet and other columnar formats
Familiarity with Spark or Flink
Knowledge of database internals