PHP Tutorials: Search Engine Crawler Detection

[YZpilot736]

another cool function that you've taught me fantastic! by chance are you on facebook alex?

[bubeto1998]

Briliant tutorials, Alex! Keep the good work!

[idiotrun1997]

On the line $useragent = $_server

it says there is a fatal error, function must be a string. Help?

[elvisniperx]

so what if you have been crawled? will you earn millions or dollars?! lmao jk

[bubeto1998]

@elvisniperx Well as a mather of fact, the beginners will learn how to separate functions for each browser by this helpful piece of code.

[SlamTubeYou]

Great tutorials alex,

Im trying to work out this tutorial i have used this code:

im using the code to create the file: $file = fopen("test.txt","a"); and it doesnt create the file in my directory.

any ideas?

[steveknau]

@SlamTubeYou Make sure the directory is writeable by others (look into changing permissions). If it still isn't working, add the following code on the very top of your page (before any other code): ini_set("display_errors", 1) ;

Good luck!

[nathanaeldjohnson]

Good video. Theres only one thing I can't figure out. I've been searching around all night for a way to add more then one search into this script but came up with nothing

[aloykatos]

what about bing

[joeydisessa]

Hey Alex - always great videos, when i use the Googlebot script it works great however the txt file that is saved an written to for some reason i cant get the text to write on separate lines, In your video you added \n to the end of the text and it created a line break. Im using Windows 7 and have copied your script to a T and still no lone breaks, any ideas?

[thevividhaze]

That's awesome, never knew you could do that!

[vb6help]

this is what you got .htaccess and robots.txt for :D

[tomturton]

Great tutorial!

To expand on it for anyone who's interested, it might be a good idea to append the date to each of the "You've been crawled" lines so you know when the site was crawled.

[webdevelopmentvideos]

I believe that you misspelled the "stripos()" function. The correct spelling should be "strpos()".

Thank you for the great tutorials btw.

[tomturton]

stripos() is just the case-insensitive version of strpos(). Both should work fine for this example

[omanoman98]

Good thinking and nicely made video!

Thanks Alex!

For some reason, the code here does not work with IE7 but it perfectly works with Firefox

[XxGodDogxX]

whats does it accualy mean when your site has been crawled.?

[bowersbros]

if it has been updated or indexed into google or Yahoo etc.

if you have been crawled, you have been updated on a search engine.

[KoolKid417]

pastebin com / f597e4411

[KoolKid417]

Woops, forgot to put what it is.. :)

That is my 'advanced' log script. Have fun :D