#------------------------------------------------------------------------ # # Apply the following rules to robots that understand version 1.0 # specification. # Permit all user agents (robots) access to all areas of the web site. # Apply a request rate limit of 1 document per 60 seconds, to alleviate # unnecessary pressure on the web server. # The Sitemap rule points to user agents that understand it where to # find an XML-formatted site map. # #------------------------------------------------------------------------ User-Agent: * Robot-version: 1.0 Request-rate: 1/60 Allow: / Sitemap: /sitemap/sitemap.xml