BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Topics

Choose your language

InfoQ Homepage Presentations Spring XD for Real-time Hadoop Workload Analysis

Spring XD for Real-time Hadoop Workload Analysis

Bookmarks
01:21:15

Summary

The authors explain how the Pivotal team leveraged familiar SQL-based queries to analyze fine-grained cluster utilization using Spring XD to ingest YARN service and MapReduce application logs through a real-time data pipeline into HDFS.

Bio

Vineet Goel is Principal Product Manager, Big Data at Pivotal. Rodrigo Meneses is Principal Software Engineer at Pivotal. Girish Lingappa is Engineer at Pivotal.

About the conference

Pivotal and No Fluff Just Stuff bring you SpringOne 2GX 2014, a one-of-a-kind conference for application developers, solution architects, web operations and IT teams who develop business applications, create multi-device aware web applications, design cloud architectures, and manage high performance infrastructure. The sessions are specifically tailored for developers using the hugely popular open source Spring IO projects, Groovy & Grails, Cloud Foundry, Hadoop and Tomcat technologies. Whether you're building and running mission-critical business applications, designing the next killer cloud or big data application, SpringOne 2GX will keep you up to date with the latest enterprise open source technology.

Recorded at:

Nov 30, 2014

BT