Data Science Wire

We open-sourced Filament, a data movement engine in Go (full loads, incremental, CDC). Apache 2.0

Reddit r/ETL1w4 min read

Hey all, Mitch here, one of the founders of Galaxy. Full disclosure, this is our project. We open sourced it last week and I wanted to bring it here first, because this community is who we built it for. Filament is a data movement engine written in Go. It handles full loads, incremental syncs, and CDC from databases and HTTP APIs into Postgres, MySQL, ClickHouse, Iceberg, and S3, and it's Apache 2.0. https://github.com/galaxy-io/filament Every data project we've ever worked on started with the same boring problem of getting records out of operational systems and into somewhere useful. We've bo

Read the full story at Reddit r/ETL

More in Data Engineering