MPI Cluster Programming with Python and Amazon EC2

PyCon 2008 Talk by
Peter Skomoroch (Juice Analytics)

Amazon EC2 may offer the possibility of high performance computing to programmers on a budget. Instead of building and maintaining a permanent Beowulf cluster, we can launch a cluster on-demand using Python and EC2. This talk will cover the basics involved in getting your own cluster running using Python, demonstrate how to run some large parallel computations using Python MPI wrappers, and show some initial results on cluster performance.

Slides available at http://us.pycon.org/2008/conference/schedule/event/10/

Category:

Science & Technology

Tags:

• pycon
• 2008
• python
• case
• study
• cloud
• computing
• distributed
• performance
• tutorial

[waroftheworldseu]

The link leads to a missing page

[Romxero]

@logistix111

Try kernel hacks like Kerrighed, OpenMosix, etc etc. Those you don't have to change applications, apps like Jack will spawn multiple forks if you allow it to, then they can be distributed. If you have a really nice cluster, then you could run a modified kernel as a virtual machine with those kernel mods and run them whatever program you are using.

[hwy9nightkid]

no audio

[logistix111]

Better question: How do I get John The Ripper to run on a cluster? It runs fine on a regular computer, but obviously that's not fast enough!

[ichetan]

Sound too low, do you wan to upload it again ?