Skip to content. Skip to navigation

512.879.9350
Austin SEO Services

slogan
Learn Today How to Make Search Engines Bring You Targeted Traffic and Close More Sales
Document Actions

How to add the Sitemap Tag to your Robots.txt file

Sitemap Tag: Add your Sitemap location to robots.txt file so the search engines can find your XML, HTML or TXT Sitemap.

In your robots.txt file on a line by itself, add the following command to tell the search engines your Sitemap location:

Sitemap: <sitemap_location>
The <sitemap_location> should be the complete URL to your Sitemap according to sitemaps.org.

Below is 4WebResults.com's robots.txt file with the Sitemap Tag. 

User-agent: *
Sitemap: http://4webresults.com/google-sitemaps
Disallow: /createMember
Disallow: /portal_memberdata/portal_factory/
Disallow: /*sendto_form$
Disallow: /*folder_contents$
Disallow: /*_edit$
Disallow: /*month:int*
Disallow: /*SimpleBlogDaySearch*

We are using our XML Sitemap file.  You can also you use a text Sitemap or HTML Sitemap file.

Sitemap: http://www.example.com/sitemap.txt

 

Sitemap: http://www.example.com/sitemap.htm

The following sources were used to put the blog together:

sitemaps.org: http://www.sitemaps.org/protocol.php#informing

Market Position: http://www.marketposition.com/blog/archives/2007/05/teaching_new_tr_1.html.

_____
tags:
Thursday, May 31, 2007 in SEOSitemap Tagrobots.txt  | Permalink |  Comments (1)
del.icio.us   Digg   Yahoo   Google   Spurl

XML sitemaps

Posted by Aghochikyan at 2007-06-02 02:55 AM

If you have any problems to create XML sitemap files for your sites or to notify search engines about updated sitemap files, try Sitemap Writer Pro. It is a powerfull tool that helps you to create and keep up-to-date sitemaps for your websites. Sitemap Writer Pro has new tools - FTP manager for uploading sitemaps, search engine notification tool (now supports Ask.com and MSN.com), site crawler for adding an URLs into the sitemap and Yahoo Index viewer.