: This Top Brown Viewlet registered to qPloneSkinBrio product

You are here: Home → Internet Marketing Solutions and Social Media Blog → How to add the Sitemap Tag to your Robots.txt file

May

How to add the Sitemap Tag to your Robots.txt file

by Bill Baker on 05/31/2007

Filed Under:

Sitemap Tag: Add your Sitemap location to robots.txt file so the search engines can find your XML, HTML or TXT Sitemap.

In your robots.txt file on a line by itself, add the following command to tell the search engines your Sitemap location:

Sitemap: <sitemap_location>

The <sitemap_location> should be the complete URL to your Sitemap according to sitemaps.org.

Below is 4WebResults.com's robots.txt file with the Sitemap Tag.

User-agent: *
Sitemap: http://4webresults.com/sitemap.xml
Disallow: /createMember
Disallow: /portal_memberdata/portal_factory/
Disallow: /*sendto_form$
Disallow: /*folder_contents$
Disallow: /*_edit$
Disallow: /*month:int*
Disallow: /*SimpleBlogDaySearch*

We are using our XML Sitemap file. You can also you use a text Sitemap or HTML Sitemap file.

Sitemap: http://www.example.com/sitemap.txt

Sitemap: http://www.example.com/sitemap.htm

The following sources were used to put the blog together:

sitemaps.org: http://www.sitemaps.org/protocol.php#informing

Market Position: http://www.marketposition.com/blog/archives/2007/05/teaching_new_tr_1.html.

Send To

Print page

Share/Bookmark

XML sitemaps

Posted by Aghochikyan at Feb 19, 2009 07:30 AM

If you have any problems to create XML sitemap files for your sites or to notify search engines about updated sitemap files, try Sitemap Writer Pro. It is a powerfull tool that helps you to create and keep up-to-date sitemaps for your websites. Sitemap Writer Pro has new tools - FTP manager for uploading sitemaps, search engine notification tool (now supports Ask.com and MSN.com), site crawler for adding an URLs into the sitemap and Yahoo Index viewer.