Data Science Wire

Hardware accelerated ETL for real time crypto analytics just got me roasted by the trading team

Reddit r/bigdata1w4 min read

So... im working on our hardware accelerated ETL for real time crypto analytics, wiring up this shiny FPGA backed pipeline that our infra team is super proud of. For context we stream chain data, normalize it, then publish signals to a dashboard that our traders use to watch a few hot wallets. Yesterday I pushed what I thought was a simple config change to test a new aggregation path on the accelerated layer. Except I pointed the test stream at the prod topic and our low latency alerts started screaming that a major market maker was dumping tokens and pulling liquidity. Trading desk went full

Read the full story at Reddit r/bigdata

More in Data Engineering