InfoQ Homepage Real Time Content on InfoQ
-
Samza in LinkedIn: How LinkedIn Processes Billions of Events Everyday in Real-time
Neha Narkhede of Kafka fame shares the experience of building LinkedIn's powerful and efficient data pipeline infrastructure around Apache Kafka and Samza to process billions of events every day.
/presentations/samza-linkedin-2014/en/mediumimage/Nehabig.jpg)
-
My Mobile App Only Works on My Phone? How to Scale Enterprise Mobile Apps
The authors discuss patterns and technologies needed to scale large enterprise mobile systems, covering handling network connectivity, data reliability and real-time communication.
/presentations/scale-enterprise-mobile-apps/en/mediumimage/Casbig.jpg)
-
Real-Time Systems at Twitter
Brian Degenhardt discusses lessons that Twitter learned managing a high rate of change and complexity, and how those can be applied anywhere.
/presentations/real-time-twitter/en/mediumimage/Brianbig.jpg)
-
Building Real-time Web Applications with Stratified JavaScript
Alexander Fritze shows how to build real-time web app with Conductance, a web app server built on Stratified JavaScript which includes support for modularity and composability of asynchronous code.
/presentations/real-time-app-stratified-javascript/en/mediumimage/Albig.jpg)
-
Design Patterns for Large-Scale Real-Time Learning
Sean Owen provides examples of operational analytics projects, presenting a reference architecture and algorithm design choices for a successful implementation based on his experience Oryx/Cloudera.
/presentations/pattern-real-time-learning/en/mediumimage/Seanbig.jpg)
-
From The Lab To The Factory: Building A Production Machine Learning Infrastructure
Josh Wills discusses using Hadoop technologies to build real-time data analysis models with a focus on strategies for data integration, large-scale machine learning, and experimentation.
/presentations/machine-learning-infrastructure/en/mediumimage/Joshbig.jpg)
-
Samza: Real-time Stream Processing at LinkedIn
Chris Riccomini discusses: Samza's feature set, how Samza integrates with YARN and Kafka, how it's used at LinkedIn, and what's next on the roadmap.
/presentations/samza-linkedin/en/mediumimage/Chrisbig.jpg)
-
Add ALL the Things: Abstract Algebra Meets Analytics
Avi Bryant discusses how the laws of group theory provide a useful codification of the practical lessons of building efficient distributed and real-time aggregation systems.
/presentations/abstract-algebra-analytics/en/mediumimage/Avibig.jpg)
-
Stream Processing: Philosophy, Concepts, and Technologies
Dan Frank discusses stream data processing and introduces NSQ – Bitly’s open source queuing system – and other new technologies used for communication between streaming programs.
/presentations/data-streaming-nsq/en/mediumimage/Danbig.jpg)
-
High Speed Smart Data Ingest into Hadoop
Oleg Zhurakousky discusses architectural tradeoffs and alternative implementations of real-time high speed data ingest into Hadoop.
/presentations/real-time-hadoop/en/mediumimage/Olegbig.jpg)
-
Making the Internet a Better Place: Scaling AppNexus
Mike Nolet shares lessons learned scaling AppNexus and architectural details of their system processing 30TB/day: Hadoop, DNS built in GSLB and Keepalived, and real-time data streaming built in C.
/presentations/appnexus-architecture-scalability/en/mediumimage/Mikebig.jpg)
-
Look Ma, No Connections! Building Offline-capable Web Apps with HTML5
Bijan Vaez discusses building large-scale cross-platform mobile apps with HTML5 including offline support, real-time interactivity, and device APIs (camera, GPS).
/presentations/html5-offline-storage/en/mediumimage/Bijbig.jpg)