InfoQ Homepage Data Content on InfoQ
-
Straggler Free Data Processing in Cloud Dataflow
Eugene Kirpichov describes the theory and practice behind Cloud Dataflow's approach to straggler elimination, and the associated non-obvious challenges, benefits, and implications of the technique.
/presentations/cloud-dataflow-processing/en/mediumimage/Eubig.JPG)
-
Scaling up Near Real-Time Analytics @Uber &LinkedIn
Chinmay Soman and Yi Pan discuss how Uber and LinkedIn use Apache Samza, Calcite and Pinot along with the analytics platform AthenaX to transform data to make it available for querying in minutes.
/presentations/uber-linkedin-analytics/en/mediumimage/Chibig.JPG)
-
Effective Data Pipelines: Data Mngmt from Chaos
Katharine Jarmul discusses implementation decisions for those looking for a practical recommendation on the "what" and "how" of data automation workflows.
/presentations/data-pipelines-automation/en/mediumimage/Katbig.JPG)
-
Building Data Pipelines in Python
Marco Bonzanini discusses the process of building data pipelines and all the steps necessary to prepare data, focusing on data plumbing and going from prototype to production.
/presentations/data-pipelines-python/en/mediumimage/Marcobig.JPG)
-
Data Science in the Cloud @StitchFix
Stefan Krawczyk discusses how StitchFix used the cloud to enable over 80 data scientists to be productive and have easy access, covering prototyping, algorithms used, keeping schema in sync, etc.
/presentations/stitchfix-cloud/en/mediumimage/STebig.JPG)
-
Scaling the Data Infrastructure @Spotify
Mārtiņš Kalvāns and Matti Pehrs overview the Data Infrastructure at Spotify, diving into some of the data infrastructure components, such us Event Delivery, Datamon and Styx.
/presentations/spotify-data-infrastructure/en/mediumimage/doibig.JPG)
-
Data Microservices in the Cloud
Mark Pollack introduces Spring Cloud Data Flow enabling one to create pipelines for data ingestion, real-time analytics and data import/export, demoing apps that are deployed onto multiple runtimes.
/presentations/spring-cloud-dataflow/en/mediumimage/Markbig.JPG)
-
Targeting Your Audience: Data Visualization to Communicate Data Insights
Randy Krum explains how to use the power of data visualization to convey actionable insights to an audience, making data clear and memorable by showing the audience what the data means.
/presentations/data-visualization-data-insight/en/mediumimage/Ranbig.JPG)
-
Ingest & Stream Processing - What Will You Choose?
Pat Patterson and Ted Malaska talk about current and emerging data processing technologies, and the various ways of achieving "at least once" and "exactly once" timely data processing.
/presentations/ingest-stream-processing/en/mediumimage/PatTedbig.JPG)
-
Journey from Data Integration to Data Science
Michael Wise discusses the journey from having data integrated across an organization, to employing data science to make good use of it.
/presentations/data-integration-science/en/mediumimage/Micbig.JPG)
-
Data Driven Action: A Primer on Data Science
S Aerni, S Ramanujam and J Vawdrey present approaches and open source tools for wrangling and modeling massive datasets, scaling Java applications for NLP on MPP through PL/Java and much more.
/presentations/pl-java-nlp-mpp/en/mediumimage/Treibig.jpg)
-
Data Structure Adventures
Joseph Blomstedt presents ongoing work to build a new set of high performance data structures for Erlang, including both single process data structures as well as various concurrent data structures.
/presentations/erlang-data-structures/en/mediumimage/Jobig.JPG)