Robot.txt file is the main file in the Search Engine Optimization (SEO), robot.txt file allows the search engines to crawl your website and search engines automatically crawl your posts URL to Webmaster.
Robot.txt Files Type:
For Custom Website(HTML, PHP, etc.):
User-agent: * Allow: / Allow: /sitemap.htm Sitemap: https://example.com/sitemap.xml For Blogger:
User-agent: * Allow: / Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED For WordPress:
User-Agent: * Disallow: /wp-admin/ Sitemap: https://example.com/sitemap_index.xml Download Text File: Download
Thanks For Visiting, Team ManiBadhel
No comments:
Post a Comment