Minarrow: a fast, zero-copy Arrow-compatible data layer for Rust and Python
Reddit r/dataengineering1mo4 min read
Some of you may already be familiar with Minarrow , a from-scratch implementation of the Apache Arrow format in Rust. The project has grown considerably, particularly around Rust <-> Python interoperability, so I would like to share what it now enables. What?: Apache Arrow is the columnar runtime underpinning major libraries such as Polars, DataFusion and, optionally, Pandas. Minarrow is a from-scratch implementation of the open Arrow format that now also lets you inline Python directly inside Rust. The Pitch: Keep your application data strongly typed, SIMD-ready and native inside Rust, then c
