Robots.txt · Rajeshkumar
11 Nov 2009
Hi Friends, Did you hear anything about this robots.txt file .This file is important for web development.The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocolis used to prevent files from web crawlers or…