InfoQ Homepage Presentations Spring XD for Real-time Hadoop Workload Analysis
Spring XD for Real-time Hadoop Workload Analysis
Summary
The authors explain how the Pivotal team leveraged familiar SQL-based queries to analyze fine-grained cluster utilization using Spring XD to ingest YARN service and MapReduce application logs through a real-time data pipeline into HDFS.
Bio
Vineet Goel is Principal Product Manager, Big Data at Pivotal. Rodrigo Meneses is Principal Software Engineer at Pivotal. Girish Lingappa is Engineer at Pivotal.
About the conference
Pivotal and No Fluff Just Stuff bring you SpringOne 2GX 2014, a one-of-a-kind conference for application developers, solution architects, web operations and IT teams who develop business applications, create multi-device aware web applications, design cloud architectures, and manage high performance infrastructure. The sessions are specifically tailored for developers using the hugely popular open source Spring IO projects, Groovy & Grails, Cloud Foundry, Hadoop and Tomcat technologies. Whether you're building and running mission-critical business applications, designing the next killer cloud or big data application, SpringOne 2GX will keep you up to date with the latest enterprise open source technology.