Lets you post a sitemap of your web site to Google. A sitemap is like a map that can help Google obtain and fully grasp all the webpages on your site. txt file is then parsed and may instruct the robotic regarding which pages usually are not being crawled. To https://www.youtube.com/watch?v=ARvdj_mJDAY