Data Science Wire

frogo-cli: My attempt at making Kafka (a bit) more hackable

Reddit r/apachekafka1mo4 min read

Hey all! I’ve worked with Kafka here and there over the past few years and I’ve been really frustrated with the tooling. I took a stab at a tool which simplifies reads and writes to topics down to: frogo get <topic> —from <offset-like> —to <offset-like> frogo put <topic> —file <file-w-one-msg-per-line> GitHub link: frogo-cli As a brief overview: For ‘frogo get’ - the main idea is that an ‘offset-like’ supports literal offsets, timestamps, dates, and aliases (START, END, FUTURE). For ‘frogo put’ - the main idea is you have a file which has one message per line. Multiple formats are supported (e

Read the full story at Reddit r/apachekafka

More in Data Engineering