InfoQ Homepage Presentations Straggler Free Data Processing in Cloud Dataflow
Straggler Free Data Processing in Cloud Dataflow
46:03
Summary
Eugene Kirpichov describes the theory and practice behind Cloud Dataflow's approach to straggler elimination, as well as the associated non-obvious challenges, benefits, and implications of the technique.
Bio
Eugene Kirpichov is a Senior Software Engineer on the Cloud Dataflow team at Google, working primarily on the autoscaling and work rebalancing secret sauce as well as the Apache Beam programming model. He is also very interested in functional programming languages, data visualization (especially visualization of behavior of parallel/distributed systems), and machine learning.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.
Apr 11, 2017