Twister - Improving Google's MapReduce for Large-Scale Scientific Data Analysis

"Twister" - A new software tool released by Indiana University that supports faster execution of many data mining applications implemented as MapReduce programs. Developed by researchers from the Pervasive Technology Institute at IU, the tool extends the functionality of MapReduce, a distributed programming technique patented by Google for large-scale data processing in datacenter environments.

Twister allows MapReduce to achieve higher performance, perform faster data transfers, and reduce the time it takes to process vast sets of data for data mining and machine learning applications.

Twister - http://www.iterativemapreduce.org/

Digital Science Center - http://pti.iu.edu/dsc/

Pervasive Technology Institute - http://pti.iu.edu/

Category:

Science & Technology

Tags:

• Pervasive
• Technology
• Institute
• Digital
• Science
• Center
• Indiana
• University
• Bloomington
• Judy
• Qiu
• Jaliya
• Ekanaya
• Geoffrey
• Fox
• Twister
• Google
• MapReduce
• Map
• Reduce
• IU