# Robots.txt file from http://www.tlapple.com # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /data/ Disallow: /include/ Disallow: /templates/ Disallow: /compile/ £¼META NAME="ROBOTS" CONTENT="INDEX,FOLLOW"£¾ £¼META NAME="ROBOTS" CONTENT="NOINDEX,FOLLOW"£¾ £¼META NAME="ROBOTS" CONTENT="INDEX,NOFOLLOW"£¾ £¼META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW"£¾ sitemap:http://www.tlapple.com/sitemapxml/index.xml http://www.tlapple.com/sitemap/index.html