Correct use of Robots.txt
Jan
09
Firstly, what is the Robots.txt File This is a small file hidden in your root directory called Robots.txt which is designed to give instructions to Search Engines Bots/Spiders – Bots being short for Robots that visit your site. The file tells the Bots which files / pages it may look at and spider and which [...]
