InfoQ Homepage Presentations Accelerated Spark on Azure: Seamless and Scalable Hardware Offloads in the Cloud
Accelerated Spark on Azure: Seamless and Scalable Hardware Offloads in the Cloud
38:06
Summary
Yuval Degani shows how hardware accelerations in Azure can be utilized to speed-up Spark jobs, with the aid of RDMA (Remote Direct Memory Access) support in the VM.
Bio
Yuval Degani is a Senior Manager of Engineering in Mellanox Technologies, leading a team of software engineers based in the San Francisco. His team's focus is introducing new network acceleration technologies to Big Data and ML. Before that, Yuval was a developer, an architect and later a team lead in the areas of low-level kernel development for cutting edge high-performance network devices.
About the conference
The 6th Annual Global Big Data Conference is extended to three days based on feedback from participants. The event will feature many of the Big Data thought leaders from the industry. Annual Global Big Data Conference is an event acclaimed for its highly interactive sessions.
Nov 03, 2018