SuhailshaikWHAT IS THE USE OF ROBOTS.TXT?What does robots txt mean? A robots. txt file tells search engine crawlers which pages or files the crawler can or can’t request from your…Oct 14, 2020Oct 14, 2020