# All robots will spider the domain User-agent: * Disallow: /gallery/ Disallow: /gregarius/ Disallow: /videodb/ Disallow: /awstats/ Disallow: /images/