Loading...

HUG Meetup May 2012: Oozie: Towards a Scalable Workflow Scheduling System for Hadoop (Part 2)

420 views

Loading...

Loading...

Loading...

Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Published on May 18, 2012

Speakers: Mohammad Islam and Virag Kothari, Yahoo!
During the past three years Oozie has become the de-facto workflow scheduling system for Hadoop. Oozie has proven itself as a scalable, secure and multi-tenant service. Oozie stably processes more than 45% of the jobs run across more than 25 Hadoop clusters in Yahoo. At the same time adoption in other enterprises has increased substantially since Oozie was contributed to the Apache community. We attribute these achievements to design decisions that was selected to be presented at a workshop during the ACM/SIGMOD conference. This presentation covers the key architectural design choices described in the paper. Operational metrics will be used to illustrate production experience at Yahoo, and we will also include a quick tutorial.

Loading...

to add this to Watch Later

Add to

Loading playlists...