Add a esrun.txt file to your site with "Disallow esrun scraper" and I won't scrape the serps anymore :)
Google is the biggest scraper of them all. Constantly forcing people to add files to their site or look at the recent wifi scraping. We have to change the SSID of our wifi router just to stop Google from slurping information about it?
Fine. Have it that way. But if you don't want people to scrape Google then you'll have to follow our guidelines on blocking our scrapers :)
@twparker1 You can check Wiki for "Web scraping" for the exact definition, but its pretty much when a website is created to go to google and copy (or scrape) the content and bring it back to the originating website. From there the data can either be displayed (for example, without their ads, or in a different format), or stored in a database. It slows server resources cause they can scrape 1000's of pages in a very short time, much faster than a human, and it can overload the servers.
Its really beneficial to all the online marketers to have a useful keyword ranking tool from Google itself. Most of the available tools are not able to provide exact rankings and also they unnecessarily increase the search volume.
Why not provide rankings up to Page 2? I don't think that would strain the system too much, and by providing a free tool, your overall CTRs wouldn't be quite so deflated.
i hate how the results in webmaster tools 'Top Search Queries' are NEVER accurate to the current situation and usually pretty darn old.... anyone? - @kronis
K, so first you say, don't scrape - don't check rankings. Then you say IF your ranking #5... Work on #2? And you'll know this by server logs? Sever logs don't tell your position?
"How adding ONE tool in webmaster central would unsubscribe thouands of Web Position Gold subscribers and increase Google's bandwidth for the general public" Seems like a no brainer.. no?
Server logs show you what words are bringing people to your site, and his point is to pay more attention to those click-through keywords and targeting or expanding them, based on the server-log results, rather than spending most of your time seeing where you rank on the SERPs. It's a "Both-and" thing, not an "Either-Or," but working with your keywords should take priority over just seeing where you rank. There are plenty of keywords that DO show LESS relevant sites at #1, e.g. parked domains.
Almost 50 years ago I got hooked smoking cigarettes. Some people said; blame it on the cigarettes manufactures... Who do you think is going to be blame when the ranking junkie can't get another fix? :) j/k :) Love these videos... Keep them coming!
Thanks for answering this! SEO's working on sites w/little or no keyword optimization may desire a rank checker to expedite the review process once SEO mechanics are installed. Plus it helps keep an accurate record on loss/gain in keyword rank over time. While I believe more established sites should focus on core terms yielding traffic, it would be useful for a site in need of stronger optimization. I get your reason for not yet providing a tool - allocate the time to more worthwhile projects.
I have many SEO clients, and what I do is get people's rankings higher on Google. That is what I am measurable against. Measurable? How? Matt, you say get a top 20 to top 5! I agree. But how do we know its top 5. It is great to manually check a few clients. Get many clients and automated system needed. Trigger reports-rankings +-5, tables showing +-/ % top 5...
I recommend you put work into a better API (now defunct) based on country/geolocation parameters, then let people develop programs.
Add a esrun.txt file to your site with "Disallow esrun scraper" and I won't scrape the serps anymore :)
Google is the biggest scraper of them all. Constantly forcing people to add files to their site or look at the recent wifi scraping. We have to change the SSID of our wifi router just to stop Google from slurping information about it?
Fine. Have it that way. But if you don't want people to scrape Google then you'll have to follow our guidelines on blocking our scrapers :)
onlinehoster 2 months ago
This has been flagged as spam show
This is yantram bpo services pvt. Ltd. provides online Dataentry services WebReserachServices,internetresearchServices,OutsourcingWebResearch,WebResearchIndia,MarketResearchCompanyIndia.
dataentryify 8 months ago
:::Attention::: bot252 from ubotstudios com approves of GoogleWebmasterHelp's videos. That is all.
ubotstudios11 8 months ago
p.S i think question was aimed towards page rank checking.. NOT keywords ranking.
TdRaidX 1 year ago
I don't know about this video. Do you habe any others that can back it up?
expertreviewsdotcom 1 year ago
Mats presentation skills have really come along way since this vid... :0
figurethis2 1 year ago
@figurethis2 Thats true, true
milkfish87 1 year ago
This has been flagged as spam show
nice video. i want to bookmark this page.
cheapseoservice 1 year ago
Klasse... Prima gemacht...
calabenirras 1 year ago
this was a very good answer
peterpixo 2 years ago
What does scrapping mean?
twparker1 2 years ago
@twparker1 You can check Wiki for "Web scraping" for the exact definition, but its pretty much when a website is created to go to google and copy (or scrape) the content and bring it back to the originating website. From there the data can either be displayed (for example, without their ads, or in a different format), or stored in a database. It slows server resources cause they can scrape 1000's of pages in a very short time, much faster than a human, and it can overload the servers.
louishcom 1 year ago
Its really beneficial to all the online marketers to have a useful keyword ranking tool from Google itself. Most of the available tools are not able to provide exact rankings and also they unnecessarily increase the search volume.
lendingstream 2 years ago
Does this mean the digitalpoint keyword tracker is bad?
wredlich 2 years ago
Why not provide rankings up to Page 2? I don't think that would strain the system too much, and by providing a free tool, your overall CTRs wouldn't be quite so deflated.
JeffSMills 2 years ago
i hate how the results in webmaster tools 'Top Search Queries' are NEVER accurate to the current situation and usually pretty darn old.... anyone? - @kronis
kron3r 2 years ago
K, so first you say, don't scrape - don't check rankings. Then you say IF your ranking #5... Work on #2? And you'll know this by server logs? Sever logs don't tell your position?
"How adding ONE tool in webmaster central would unsubscribe thouands of Web Position Gold subscribers and increase Google's bandwidth for the general public" Seems like a no brainer.. no?
danieljdeyette 2 years ago
Server logs show you what words are bringing people to your site, and his point is to pay more attention to those click-through keywords and targeting or expanding them, based on the server-log results, rather than spending most of your time seeing where you rank on the SERPs. It's a "Both-and" thing, not an "Either-Or," but working with your keywords should take priority over just seeing where you rank. There are plenty of keywords that DO show LESS relevant sites at #1, e.g. parked domains.
todnyc 2 years ago
Almost 50 years ago I got hooked smoking cigarettes. Some people said; blame it on the cigarettes manufactures... Who do you think is going to be blame when the ranking junkie can't get another fix? :) j/k :) Love these videos... Keep them coming!
Luckyghost1 2 years ago
Thanks for answering this! SEO's working on sites w/little or no keyword optimization may desire a rank checker to expedite the review process once SEO mechanics are installed. Plus it helps keep an accurate record on loss/gain in keyword rank over time. While I believe more established sites should focus on core terms yielding traffic, it would be useful for a site in need of stronger optimization. I get your reason for not yet providing a tool - allocate the time to more worthwhile projects.
SavouryFlavour 2 years ago
The joys of twitter. Matt, you should have twittered about it when you posted it here, not days later ;)
searchmasters 2 years ago
I have many SEO clients, and what I do is get people's rankings higher on Google. That is what I am measurable against. Measurable? How? Matt, you say get a top 20 to top 5! I agree. But how do we know its top 5. It is great to manually check a few clients. Get many clients and automated system needed. Trigger reports-rankings +-5, tables showing +-/ % top 5...
I recommend you put work into a better API (now defunct) based on country/geolocation parameters, then let people develop programs.
searchmasters 2 years ago
but we ARE obsessed with rankings...
cant help it.... ;)
chempranav 2 years ago
Matt add to video subtitle please. thanks.
wolkanca 2 years ago
Very informative Matt - it would be great to expand the Webmaster Tools functionality.
DanNedelko 2 years ago
Interesting video .. Thanks
routenote 2 years ago