# I generally don't mind if robots visit this site.  But some subdirectories are off limits

User-agent: *
Disallow: admin
Disallow: database
Disallow: include
Disallow: tests