Concurrency: Past and Present
Brian Goetz discusses the difficulties of creating multithreaded programs correctly, incorrect synchronization, race conditions, deadlock, STM, concurrency, alternatives to threads, Erlang, Scala.
Presentation
Recorded at:
Randy Shoup on eBay's Architectural Principles
Posted by Randy Shoup on Feb 05, 2008 05:00 PM
Summary
Randy Shoup covers the architectural principles eBay has used to grow and evolve its infrastructure to massive scale. It covers the forces ("-ilities") needed to contend with and design for scalability, availability, manageability, etc. He outlines eBay's architectural principles which meet - and trade off - those forces and describes reusable patterns for each strategy with eBay examples.
Bio
Randy Shoup is a Distinguished Architect in the eBay Marketplace Architecture group. Since 2004, he has been the primary architect for eBay's search infrastructure. Prior to eBay, he was Chief Architect at Tumbleweed Communications, and held a variety of roles at Oracle and Informatica. He has a BS in Mathematical and Computational Science, and an AB in Political Science, from Stanford University.
About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.
Randy Shoup covers the architectural principles eBay has used to grow and evolve its infrastructure to massive scale. It covers the forces ("-ilities") needed to contend with and design for scalability, availability, manageability, etc. He outlines eBay's architectural principles which meet - and trade off - those forces and describes reusable patterns for each strategy with eBay examples.
Bio
Randy Shoup is a Distinguished Architect in the eBay Marketplace Architecture group. Since 2004, he has been the primary architect for eBay's search infrastructure. Prior to eBay, he was Chief Architect at Tumbleweed Communications, and held a variety of roles at Oracle and Informatica. He has a BS in Mathematical and Computational Science, and an AB in Political Science, from Stanford University.
About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.
RelatedVendorContent
Hibernate without Database Bottlenecks
Scale Your Application without Punishing Your Database
Guide to Calculating ROI with Terracotta Open Source JVM Clustering
Why Should I Care About Terracotta?
Terracotta 2.6 - Download now for scalability without tradeoffs
Related Sponsor
Terracotta is Scalability and Availability for Java Applications. It clusters the JVM itself, which dramatically simplifies development and reduces database dependency.
Poor Audio
by
Ray Krueger
Posted
Feb 7, 2008 8:59 AM
Re: Poor Audio
by
Surender Kumar
Posted
Feb 8, 2008 6:18 AM
Re: Poor Audio
by
Surender Kumar
Posted
Feb 8, 2008 6:19 AM
Great presentation... have you checked out this design pattern project?
by
Damon Edwards
Posted
Feb 10, 2008 10:32 PM
Re: Great presentation... have you checked out this design pattern project?
by
Randy Shoup
Posted
Feb 13, 2008 1:51 PM
ppt
by
mario reyna
Posted
Feb 14, 2008 6:53 PM
Re: ppt
by
Randy Shoup
Posted
Feb 14, 2008 8:17 PM
Fantastic presentation
by
Olivier Gourment
Posted
Mar 11, 2008 3:04 PM
-
Unfortunately the audio on this goes to hell about 15 minutes in. Don't listen with the volume too loud or you'll be punished with really loud static blasts. Ironicly the static blasts only seem to occur when he says important things :P
-
Now it doesn't start even.
-
sorry, it does but takes a while.
-
Great presentation, Randy. Have you checked out the nascent Design Patterns Project over at the Open Management Consortium? http://www.open-management.com/community/open_standards/omc_design_patterns The early efforts are around design patterns for automation, but many of the themes you touched on are well within the project's scope (of being a neutral repository for operations design patterns). -Damon http://dev2ops.org
-
Hi, Damon -- Glad you liked the presentation. Thanks a lot for the pointer to the Design Patterns Project -- I hadn't known about it before. Looks like it is off to an encouraging start. I'll be interested to see how it evolves. It certainly would be valuable to have a repository for such patterns. -- Randy
-
hello randy. where can i download the presentation? it seems like you apply very well a federated database system(or virtual database) thanks in advance
-
Hi, Mario -- A pdf version is available from the QCon SF conference track "Architectures you've always wondered about" (http://qcon.infoq.com/sanfrancisco/tracks/show_track.jsp?trackOID=70). Here is a direct link: http://www.eos1.dk/qcon/sf2007/slides/public/RandyShoup_eBayArchPrinciples.pdf You can certainly think of eBay's database strategy as federated, and we definitely virtualize the federated aspect to make the programming model simpler for the developers. "Sharding" is a related term which seems to be entering more common use. Whatever you call it, it has been critical to our ability to scale. One thing I will add is that the fact that we implement the virtualization logic inside the application server (as opposed to some intermediate tier) has made it easier to optimize connections and request routing without an additional network hop. -- Randy
-
Thank you Randy for sharing this brilliant material with us (Note: I have only read the PDF). Obviously, a number of strategies only apply to the range of massive traffic that eBay has (otherwise they come at the price of a difficult maintenance). But, still, I believe the principles are fundamentally right, and should be applied to any potentially large web site.
8 comments
Reply