Why won't the spiders leave me alone!?

[ZacFields]

Your phpBB Version: 2.0.
phpBB Type: Integramod 141
MODs: Yes
Your knowledge: Basic Knowledge
Board URL: [url]http://[/url]

PHP Version:
MySQL Version:


What was done before the problem appeared?
Someone gave me some code that told googlebot to slow down, but I think I need more than this.


What was done to try to solve the problem?




De.scription and Message

I never thought I'd be saying this, but I'm very very close to banning all search spiders from my site. I keep upgrading and upgrading my hosting, but nothing ever seems to be enough. These spiders can be malicious when you're running a .script like integramod.

What can I do about this? I don't suppose I want to ban them all completely, but I want them all to SLOW down severely... like to the point where they're using my website no faster than any normal user.

I run a local forum and really have no need for any search engine help, but we have gained a couple users off of search so that's why I don't want to resort to banning yet.

Anyone have any good solutions for this?

Zac

[ZacFields]

*Edit*

Also, FYI Inktomi seems to be hitting me pretty bad lately. I wouldn't mind just flat out blocking this bot. Honestly I think all I want is yahoo, google, and msn.

Zac

[Teelk]

Think Inktomi is Yahoo...

Try this robots.txt file, place it in your html root.