InfoQ Homepage Real-Time Data Content on InfoQ
-
Applications of Enterprise Integration Patterns to Near Real-Time Radar Data Processing
Garrett Wampole describes an experimental methodology of applying Enterprise Integration Patterns to the near real-time processing of surveillance radar data, developed by MITRE.
/presentations/mitre-enterprise-integration/en/mediumimage/Garbig.jpg)
-
Design Patterns for Large-Scale Real-Time Learning
Sean Owen provides examples of operational analytics projects, presenting a reference architecture and algorithm design choices for a successful implementation based on his experience Oryx/Cloudera.
/presentations/pattern-real-time-learning/en/mediumimage/Seanbig.jpg)
-
From The Lab To The Factory: Building A Production Machine Learning Infrastructure
Josh Wills discusses using Hadoop technologies to build real-time data analysis models with a focus on strategies for data integration, large-scale machine learning, and experimentation.
/presentations/machine-learning-infrastructure/en/mediumimage/Joshbig.jpg)
-
Stream Processing: Philosophy, Concepts, and Technologies
Dan Frank discusses stream data processing and introduces NSQ – Bitly’s open source queuing system – and other new technologies used for communication between streaming programs.
/presentations/data-streaming-nsq/en/mediumimage/Danbig.jpg)
-
High Speed Smart Data Ingest into Hadoop
Oleg Zhurakousky discusses architectural tradeoffs and alternative implementations of real-time high speed data ingest into Hadoop.
/presentations/real-time-hadoop/en/mediumimage/Olegbig.jpg)
-
Making the Internet a Better Place: Scaling AppNexus
Mike Nolet shares lessons learned scaling AppNexus and architectural details of their system processing 30TB/day: Hadoop, DNS built in GSLB and Keepalived, and real-time data streaming built in C.
/presentations/appnexus-architecture-scalability/en/mediumimage/Mikebig.jpg)
-
Integrating SQL & NoSQL & NewSQL & Realtime Data Intelligence for the Financial Industry
Charles Cai, Ashwani Roy discuss a robust, cost effective, hypothetical solution to address extreme challenges in financial institutions, from decision making support to pricing and risk management.
/presentations/finance-sql-nosql-newsql/en/mediumimage/DOibig.jpg)
-
SocketStream - A New Framework for a New Web
Owen Barnes introduces SocketStream, a Node.js framework for building single-page real-time web applications that access all of their data via WebSocket.
/presentations/SocketStream/en/smallimage/Owen.JPG)
-
Facebook News Feed: Social Data at Scale
Serkan Piantino discusses news feeds at Facebook: the basics, infrastructure used, how feed data is stored, and Centrifuge – a storage solution.
/presentations/Facebook-News-Feed/en/smallimage/Pian.JPG)
-
Real-Time Delivery Architecture at Twitter
Raffi Krikorian details Twitter’s timeline architecture, its “write path” and “read path”, making it possible to deliver 300k tweets/sec.
/presentations/Real-Time-Delivery-Twitter/en/smallimage/Rafi.JPG)
-
View Server: Delivering Real-Time Analytics for Customer Service
Richard Tibbetts presents a three-tier architecture for real-time data staging analysis, storing the results and delivering them to clients as a service accessible through a variety of interfaces.
/presentations/Real-Time-Analytics-Service/en/smallimage/Richard.JPG)
-
Design Patterns for Combining Fast Data with Big Data in Finance
Mike Stolz shares insight in combining the benefits of analyzing Big Data with those of grabbing the opportunities offered by Fast Data in the Financial Services industry.
/presentations/Design-Patterns-Fast-Data-Big-Data/en/smallimage/Mike.JPG)