InfoQ Homepage Presentations Petabytes Scale Analytics Infrastructure @Netflix
Petabytes Scale Analytics Infrastructure @Netflix
Summary
Tom Gianos and Dan Weeks discuss Netflix' overall big data platform architecture, focusing on Storage and Orchestration, and how they use Parquet on AWS S3 as their data warehouse storage layer.
Bio
Daniel Weeks manages the Big Data Compute team at Netflix and is responsible for integrating and enhancing open source big data processing technologies including Spark, Presto, Hadoop. Tom Gianos is a Senior Software Engineer, Big Data Platform at Netflix. He leads development of Genie and has a passion for merging web and big data technologies to solve interesting distributed systems problems.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.