Clang MapReduce -- Automatic C++ Refactoring at Google Scale
Loading...
Uploaded by LLVMProject on Dec 14, 2011
Google has over 100 million lines of code, and our biggest programming language is C++. We have a single, shared codebase developed primarily on mainline. We build every binary and all of its libraries from scratch every time, allowing us to incrementally evolve APIs and libraries over time. The entire development process is extremely incremental in nature, and even API-breaking changes are a regular occurrence. However, for core libraries used throughout the codebase, this development model is a huge challenge: how do we incrementally evolve an API in use by tens of thousands of other libraries? The answer is to use Clang to automatically refactor APIs and their users across the codebase. How do we scale Clang up to possibly the single largest unified codebase in the world? The same way Google scales anything else: MapReduce. By coupling Clang's library design and architecture to existing Google infrastructure we can automatically compile, analyze, and refactor the entire Google codebase in minutes. In this talk, I will dive into the challenges of refactoring C++ code, how we're using Clang and making it even better at solving them, and how we scale these solutions to the size of our codebase.
- 36 likes, 0 dislikes
-
- 3:33
First C++ Gameby pblsk8erboi732 views
- 2:05
Qt + Cling, the LLVM based C++ interpreterby dagahre478 views
- 2:20
C++ Programmerby CrankyProgrammer120,988 views
- 3:00
Clang rocks!by isalfor330 views
- 1:17
LLVM & CLANGby mrbit10lib1,652 views
- 4:48
Bjarne Stroustrup: Why I Created C++by bigthink41,431 views
- 36:10
Polly - First successful optimizations - How to proceed?by LLVMProject217 views
- 42:52
Finding races and memory errors with LLVM instrumentationby LLVMProject422 views
- 30:28
LLVM Arm Back Endby alimustafazaidi230 views
- 6:33
#1 Kurs C++ - Pierwszy programby lukaszphp17,821 views
- 28:58
On the pain caused by mixing vectors and scalarsby LoadHitStore824 views
- 2:52
Trabant songby Kogelify13,761 views
- 8:00
2008 LLVM Developers Meeting - Clang Internals - 4 of 5by openwingproject257 views
- 2:37
PHP vs. Python vs. Ruby vs. Java vs. .NETby businessgeek18,233 views
- 6:15
Paint in C++by KRIIS5513,192 views
- 2:33
FreeBSD Vs. Linuxby BlackwaterOpsDotCom11,346 views
- 8:58
Introduction to programming with C++: part 1by PetarMarendic117,626 views
- 2:37
Klocwork C/C++ Refactoring: Analyze and Optimize Headersby staticcodeanalysis380 views
- 5:20
Tiamat - Sympathy for the devil (rolling stones cover)by alternatypje256,708 views
- 1:11
2008 LLVM Developers Meeting - Clang Internals - 5 of 5by openwingproject186 views
Is there any place that we can watch for when this tool is released?
otherwiseguy 3 weeks ago
Really interesting :)
PixelAliensWorld 2 months ago
JuliaLLawall: we actually looked at Coccinelle before implementing the language, and found that it was not sufficient nor easy enough to extend for what we wanted to do in C++. Unfortunately C++ is a completely different beast from C - there are a lot more corner cases and little hidden things that are really important to match on.
manuelklimek 2 months ago
It looks similar to what Coccinelle does, although Coccinelle provides pattern matching on the concrete syntax and allows the transformation specification to be integrated directly into the pattern specification, using a patch-like notation. It doesn't seem possible to provide an example on the youtube comment page, but there are examples on the web site. Currently, however, Coccinelle only supports C code, with a very minimal treatment of C++.
JuliaLLawall 2 months ago
Really good talk!
cardologist 2 months ago