Data Science Wire

Joshua Drake: Parquet and Iceberg: An Overview

PostgreSQL Planet1mo4 min read

A pile of containers is not a shipment. A shipment is containers plus a manifest.Apache Iceberg is the manifest. It is not a file format, it is a table format: a metadata layer that records exactly which Parquet files make up a table at every point in time. That one idea buys you things we used to think required a warehouse. Transactions on object storage, so writers never …

Read the full story at PostgreSQL Planet

More in Data Engineering