Scaling Facebook with OpenSource tools

By David Recordon

This talk will give you a better idea of what it takes to scale Facebook.

From the day that Mark Zuckerberg started building Facebook in his Harvard dorm room in 2004 to today, the site has been built on common open source software such as Linux, Apache, MySQL, and PHP. Today Facebook reaches over 350 million people per month, is the largest PHP site in the World, and has released major pieces of our infrastructure as open source.

It's not possible to scale a site like Facebook simply by sharding your databases, rather we've developed and contributed to a series of open source infrastructure technologies. Some of these projects include Cassandra, Hive, Haystack, memcached, and Scribe, where each focuses on solving a specific problem with Thrift allowing them to communicate across languages. This talk will give you a better idea of what it takes to scale Facebook, a look into the infrastructure we use to do so, and dive into performance work we're focused on in order to scale PHP to over 350 billion page views per month.

FOSDEM (Free and Open Source Development European Meeting) is a European event centered around Free and Open Source software development. It is aimed at developers and all interested in the Free and Open Source news in the world. Its goals are to enable developers to meet and to promote the awareness and use of free and open source software. More info at http://fosdem.org

Category:

Education

Tags:

• FOSDEM
• FOSDEM2010
• 2010
• maintracks

[jgoemat]

Is that Seth Rogen? :)

[parpardromi]

@jgoemat if it acts like Seth and talks like Seth its probably Rogen.

[iLovePalestineDotCom]

@diffynou I don't think he had any a problem divulging the number of servers, he said it is in the 10s of thousands. The question was what percentage or number of the available servers are Memcache enabled, and he clearly did not want to make up numbers. so he said he can not answer that question.

[diffynou]

why can't they tell how many servers they have ? why is that information needs to be protected ?

[1001webs]

And Twitter is following suite. Cassandra is replacing MySQL at Twitter. It seems that the NoSQL movement. is gaining pace. Traditional relational databases, which use SQL data access, are unsuitable for the huge tasks in these Social Media sites