How does Google use human raters in web search?

Can you provide more details on how Google uses 'human raters' as part of their algorithm? AJ Kohn, SF, CA

Read more about search evaluation at Google: http://googleblog.blogspot.com/2008/0...

Have a question? Ask it in our Webmaster Help Forum: http://productforums.google.com/forum...

Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: http://twitter.com/googlewmc

More videos: http://www.youtube.com/GoogleWebmaste...
Webmaster Central Blog: http://googlewebmastercentral.blogspo...
Webmaster Central: http://www.google.com/webmasters

• Category

  Science & Technology

[Ariaan Bruinsma]

Darn, whats up with the stutter jitters in the audio?!

[GoogleWebmasterHelp]

We had a technical issue with this particular video. :-( Future videos should sound much better. If the audio gets too annoying, feel free to mute and turn on the captions.

[kommentezo]

Isn't it possible to publish the text of the captions in the video description? It would be much quicker to read them through than watching the video. Lots of people would prefer that.

[GoogleWebmasterHelp]

We don't want to stuff the description with a full transcript, but to the right of the flag button there is a button which activates the interactive transcript, which you can easily skim/read, and even use to jump to a particular section of the video.

[moneyinternetblog]

How raters can tell whether content on a site is useful or not (spam or not) if they might be not familiar with the topic they are evaluating?

[Jorge Cordova]

I feel the testers should be evaluated. That is all.

[776gvvgcd4]

■□■□■ 宝くじ２００，０００，０００円当選してしまいました…。 ■□■□■ 管理人様。お手数お掛けしますが、ご迷惑でしたら削除の方お願い­致します。長文になってしまいますので単刀直入に申します。この­宝くじの当選金をお譲りします。受け取りたい方は下記ﾌﾞﾛｸﾞ­ｻｲﾄよりご連絡下さい。一切制限など無くｽﾑｰｽﾞにお話しが­進められます。Youtubeでは違反行為になってしまい連絡が­途絶えてしまいます。できる限りご希望の金額をと考えております­。今日中にお渡しする事も出来ますので、ご遠慮せずに仰って頂け­ればと思います。宜しくお願い致しますm(__)m ﾌﾞﾛｸﾞｻｲﾄ　httｐ://785.jp /

[Stuart Preston]

Better human raters than Cylon raiders.

[AaronTheLanglo]

I've long suspected that human raters are the cause for the perceived bias toward Google-owned asset's in Google's organic SERPs. What steps (if any) are taken to prevent the inherent pro-Google bias of the "Google-paid" human raters from choosing the results sets that favor the inclusion of Google-owned assets? Wouldn't such bias would encourage adoption of algorithmic changes that favor Google-owned assets and discourage adoption of those that would be unfavorable to Google's bottom line?

[homeintegrations]

If efforts to make "a best website" possible are already being attempted by a webmaster... how does an understanding of human raters support a webmaster's ongoing efforts? Unless a site ranks #3 or so for something... the site might not ever truely understand what's holding them back from reaching a top ranking. Yes?

[MrFrezzin]

There are very specific instructions they must follow. But it's also about their experience in their locales as users and their intuition and common sense.