Robots.txt (Robots File) Explained - SEO Video Tutorial

Loading...

Sign in or sign up now!
Alert icon
Upgrade to the latest Flash Player for improved playback performance. Upgrade now or more info.
659 views
Loading...
Alert icon
Sign in or sign up now!
Alert icon

Uploaded by on Nov 25, 2011

In this week's web design video blog, Nick and I explain the purpose of a robots.txt file and also share the common Robot Exclusion Standards. Checkout the supporting code at http://www.webdesigncreare.co.uk/blog/videos/robots-txt.html

Category:

Education

Tags:

License:

Standard YouTube License

  • likes, 1 dislikes

Link to this comment:

Share to:
see all

All Comments (5)

Sign In or Sign Up now to post a comment!
  • Nicely presented!

    Although I've been working with site design for over 15 years, I know that people still overlook the power of robots.txt and wonder why info from folders/files can be found if certain strings of search words will bring up directories on their site which they've kept out of their sitemap.xml, etc.

    Just wondering whether you could take a look at my bots directives for a site used specifically for 'freebie' downloads which I don't want appearing ANYWHERE.

  • @3:04 start with admin? or private???

  • Tx for this

  • Excellant!

  • :D

Loading...

Alert icon
0 / 00Unsaved Playlist Return to active list
    1. Your queue is empty. Add videos to your queue using this button:
      or sign in to load a different list.
    Loading...Loading...Saving...
    • Clear all videos from this list
    • Learn more