+- Forums (https://supersonicforum.createmybb.com)
+-- Forum: The City (https://supersonicforum.createmybb.com/forumdisplay.php?fid=8)
+--- Forum: Sonic Supermarket (https://supersonicforum.createmybb.com/forumdisplay.php?fid=9)
+--- Thread: Robots.txt File to Improve Site Ranking! (/showthread.php?tid=721)
Robots.txt File to Improve Site Ranking! - loopsspirtal - 11-08-2012
Not many web master take the time to use a robots.txt file for their website. For search engine spiders that use the robots.txt to see what directories to search through, the robots.txt file can be very helpful in keeping the spiders indexing your actual pages and not other information, such as looking through your stats and dynamic pages! Read to learn more how to keep the search engines out of unwanted information, and only reading what you want them to read!