Dedupe, Merge, and Purge: the Art of Normalization
Loading...
Uploaded by factualvideo on Nov 9, 2011
Big Noise always accompanies Big Data, especially when extracting entities from the tangle of duplicate, partial, fragmented and heterogeneous information we call the Internet. The ~17m physical businesses in the US, for example, are found on over 1 billion webpages and endpoints across 5 million domains and applications. Organizing such a disparate collection of pages into a canonical set of things requires a combination of distributed data processing and human-based domain knowledge. This presentation stresses the importance of entity resolution within a business context and provides real-world examples and pragmatic insight into the process of canonicalization.
Info on Strata Conference website: http://strataconf.com/stratany2011/public/schedule/detail/21389
Slides on Slideshare: http://www.slideshare.net/TylerBell/dedupe-merge-and-purge-the-art-of-normali...
- 0 likes, 0 dislikes
-
- 4:12
How To: Merge Duplicate Facebook Pagesby LBMediaVideos739 views
- 18:37
Tim O'Reilly Talks Trends Around Data #strataconfby siliconangle293 views
- 1:19
Facebook: How to report a claim to pageby odigma783 views
- 41:12
O'Reilly Strata, Joseph Turian: New Developments in Large Data Techniquesby josephturian594 views
- 33:51
Venture Capitalist Charles Beeler on the Big Data Market Changing the Worldby siliconangle181 views
- 5:02
Tips & Tricks: Merging TWO Facebook fan pagesby livewirefilmz9,780 views
- 4:16
ClickFox CEO Marco Pacelli Explains the Whitespaces for Startups in Big Databy siliconangle432 views
- 30:09
Strata Online Conference - Building Data Startups, Mike Driscollby OreillyMedia514 views
- 16:29
Strata New York 2011: Arnab Gupta, "Calling for a New Paradigm: Machines Plus Humans"by OreillyMedia508 views
- 10:39
Strata New York 2011: Randy Lea, "Simplifying Big Analytics for the Business"by OreillyMedia366 views
- 7:13
Gil Elbaz interviewed at Web 2.0 Summit 2011by OreillyMedia305 views
- 5:43
Strata New York 2011: Ken Bado, "Big Data, Big Opportunity"by OreillyMedia280 views
- 10:44
Strata Summit 2011: Edd Dumbill, "Welcome & Opening Remarks"by OreillyMedia132 views
- 8:56
Rapidly Build Parallel Applications for Big Databy liveyize669 views
- 7:35
Technology for Accelerating Your Backup: IT as a Weapon 3/6by FalconStor180 views
- 5:14
Finding Duplicates with Merge-Purge.mp4by MailersMVP99 views
- 17:15
Strata Summit 2011: Michael Ferrari, "Atmospheric Analytics"by OreillyMedia98 views
- 6:22
Do NOT Merge your Facebook Business or Fan Page with your Facebook Places placeby TurnKeySocialMedia1,341 views
- 28:58
Strata Jumpstart 2011: Simon Wardley, "Situation Normal, Everything Must Change"by OreillyMedia1,858 views
- 12:41
Strata New York 2011: Hilary Mason, "Short URLs, Big Data: Learning About the World in Realtime"by OreillyMedia1,786 views
Link to this comment:
All Comments (0)