Monday, September 16, 2013

Video: Configuring large scale distributed systems by Ulf Lilleengen

0 comments

This talk will present the configuration system designed to manage run-time configuration for some of Yahoo!s serving systems; describing how this system, developed by a small development team in Trondheim, tackles some of the very real challenges when managing a large distributed system.

Managing a small system is simple. But as a system grows, more services are added, and data and computation needs to be distributed. All of a sudden, you find yourself in a configuration nightmare, where both the time needed to change the configuration and human errors made in the process increase. A large scale system typically involves thousands of hosts, and multiple processes running on each of those hosts.

Cloud platforms such as Heroku and Amazon tries to simplify this by providing higher level abstractions of the services and how they are connected. This requires that they run some system management of the software running inside the cloud. In Yahoo!, we run large scale systems, and this talk will describe the configuration system developed by a small development team in Trondheim to manage run-time configuration for many of Yahoo!’s serving systems.


Configuring large scale distributed systems from JavaZone on Vimeo.

Leave a Reply

 
All Tech News IN © 2011 DheTemplate.com & Main Blogger .