Subject
4 entries
Stream Processing
Bookmarks
Deploying Storm on GCE
Tutorial on deploying Apache Storm on Google Compute Engine — a setup guide for real-time stream processing at a time when cloud deployments of Storm were uncommon. GCE was a relatively new platform and Storm was the dominant real-time processing framework before Flink/Spark Streaming.
Yahoo! Spinning Continuous Computing with YARN
Yahoo's 2013 exploration of using YARN as a substrate for continuous/streaming computation beyond batch MapReduce. An early signal that the Hadoop ecosystem was trying to absorb real-time processing use cases before Apache Spark and Flink fully took over.
5 Reasons Why the Future of Hadoop Is Real-Time
GigaOM's 2013 argument for why Hadoop was evolving toward real-time processing — covering YARN, Storm, and in-memory frameworks as the drivers. A snapshot of the moment when batch-only Hadoop started feeling inadequate.
How Prismatic Deals with Data Storage and Aggregation
Prismatic's 2012 engineering post on their data architecture for real-time news personalization — using Storm for stream processing, Cassandra for distributed storage, and a Clojure-based interest graph. An early look at the stream-processing stack that became standard infrastructure.