InfoQ Homepage Twitter Content on InfoQ
-
Storm: Distributed and Fault-tolerant Real-time Computation
Nathan Marz explain Storm, a distributed fault-tolerant and real-time computational system currently used by Twitter to keep statistics on user clicks for every URL and domain.
/presentations/Storm/en/smallimage/Nathan.JPG)
-
Big Data in Real Time at Twitter
Nick Kallen discusses how Twitter handles large amounts of data in real time by creating 4 data types and query patterns -tweets, timelines, social graphs, search indices-, and the DBs storing them.
/presentations/Big-Data-in-Real-Time-at-Twitter/en/smallimage/Nick.JPG)
-
NoSQL at Twitter
Ryan King presents how Twitter uses NoSQL technologies - Gizzard, Cassandra, Hadoop, Redis - to deal with increasing data amounts forcing them to scale out beyond what the traditional SQL has to offer
/presentations/NoSQL-at-Twitter-by-Ryan-King/en/smallimage/Ryan.JPG)
-
NoSQL at Twitter
Kevin Weil presents how Twitter does data analysis using Scribe for logging, base analysis with Pig/Hadoop, and specialized data analysis with HBase, Cassandra, and FlockDB.
/presentations/NoSQL-at-Twitter/en/smallimage/Kevin Weil.JPG)
-
Abstractions at Scale–Our Experiences at Twitter
Marius Eriksen considers that leaky abstractions lead to scalability issues, while those providing narrow access to explicit resources - map-reduce, shared-nothing web apps, big table - scale better.
/presentations/Abstractions-at-Scale/en/smallimage/Marius Eriksen.JPG)