Sheesh, I watched TeomaBot (the AskJeeves webcrawling bot) go through my site like five or six times over the last two days, pounding the hell out of the box with requests every fifteen seconds and ignoring my robots.txt file outright. How annoying. Check out the site stats to see how much TeomaBot has hit UltraMookie.Com. I've added them to a deny statement in my httpd.conf file now because of this blatantly rude behaviour. GoogleBot and InktomiBot are very nice and respect the robots.txt file and don't pound my machine all at once. I'm still iffy about Altavista's bot because it pounded me so badly the other day, but it seems to have subsided since then. We'll see.