InfoQ Homepage Big Data Content on InfoQ

Articles

RSS Feed

Newer Older

AI, ML & Data Engineering

Cassandra: The Definitive Guide, 2nd Edition Book Review and Interview

Cassandra: The Definitive Guide, 2nd Edition book authored by Jeff Carpenter and Eben Hewitt covers the Cassandra NoSQL database version 3.0. Authors discuss several different important topics related to this popular database, including data modeling and Cassandra architecture. InfoQ spoke with Jeff Carpenter about the book and Cassandra database current features and future roadmap.

Srini Penchikala
on Jan 05, 2017
AI, ML & Data Engineering

Article Series: Getting a Handle on Data Science as a Software Developer

Software developers and managers are realizing that they need data science among their skills, to be able to tackle pressing problems. In this series, field experts provide guidance to help us navigate among the available data analysis options. They explore ways of understanding where data science is needed and where it’s not, and how to turn it into an asset.

Francine Bennett
on Dec 05, 2016
AI, ML & Data Engineering

Peter Cnudde on How Yahoo Uses Hadoop, Deep Learning and Big Data Platform

Yahoo uses Hadoop for different use cases in big data & machine learning areas. They also use deep learning techniques in their products like Flickr. InfoQ spoke with Peter Cnudde on how Yahoo leverages big data platform technologies.

Srini Penchikala
on Oct 13, 2016
AI, ML & Data Engineering

Traffic Data Monitoring Using IoT, Kafka and Spark Streaming

Internet of Things (IoT) is an emerging disruptive technology and becoming an increasing topic of interest. One of the areas of IoT application is the connected vehicles. In this article we'll use Apache Spark and Kafka technologies to analyse and process IoT connected vehicle's data and send the processed data to real time traffic monitoring dashboard.

Amit Baghel
on Sep 28, 2016
AI, ML & Data Engineering

Big Data Processing with Apache Spark - Part 5: Spark ML Data Pipelines

With support for Machine Learning data pipelines, Apache Spark framework is a great choice for building a unified use case that combines ETL, batch analytics, streaming data analysis, and machine learning. In this fifth installment of Apache Spark article series, author Srini Penchikala discusses Spark ML package and how to use it to create and manage machine learning data pipelines.

Srini Penchikala
on Sep 24, 2016
AI, ML & Data Engineering

Spark GraphX in Action Book Review and Interview

“Spark GraphX in Action” book from Manning Publications, authored by Michael Malak and Robin East, provides a tutorial based coverage of Spark GraphX, the graph data processing library from Apache Spark framework. InfoQ spoke with authors about the book and Spark GraphX library as well as overall Spark framework and what's coming up in the area of graph data processing and analytics.

Srini Penchikala
on Sep 12, 2016
AI, ML & Data Engineering

Chris Fregly on the PANCAKE STACK Workshop and Data Pipelines

InfoQ Interviews Chris Fregly, organizer for the 4000+ member Advanced Spark and TensorFlow Meetup about the PANCAKE STACK workshop, Spark and building data pipelines for a machine learning pipeline

Dylan Raithel
on Aug 29, 2016
AI, ML & Data Engineering

Christine Doig on Data Science as a Team Discipline

Christine Doig spoke at this year's OSCON Conference about data science as a team discipline and how to navigate the data science Python ecosystem. InfoQ spoke with Christine about challenges data science teams need to address to be more effective.

Srini Penchikala
on Aug 26, 2016
AI, ML & Data Engineering

Big Data Analytics with Spark Book Review and Interview

Big Data Analytics with Spark book, authored by Mohammed Guller, provides a practical guide for learning Apache Spark framework for different types of big-data analytics projects, including batch, interactive, graph, and stream data analysis as well as machine learning. InfoQ spoke with author about the book & development tools for big data applications.

Srini Penchikala
on Jun 23, 2016
AI, ML & Data Engineering

Big Data Processing with Apache Spark - Part 4: Spark Machine Learning

In this fourth installment of Apache Spark article series, author Srini Penchikala discusses machine learning concepts and Spark MLlib library for running predictive analytics using a sample application.

Srini Penchikala
on May 15, 2016
AI, ML & Data Engineering

The Role of a Data Scientist in 2016

Data Scientist role has been getting lot of attention lately as organizations are starting to use big data processing and analytics techniques to gain insights into their data. This post takes a closer look at the role of a Data Scientist in 2016.

Ed Jones
on Mar 27, 2016
AI, ML & Data Engineering

Unified Data Modeling for Relational and NoSQL Databases

Current enterprise data architectures include NoSQL databases co-existing with relational databases. However, NoSQL data management currently lacks mature methods and tools to manage NoSQL data. In this article, author discusses a solution for managing both NoSQL and relational databases using Unified Data Modeling techniques.

Allen Wang
on Feb 28, 2016