Why won't the spiders leave me alone!?
Posted: Sat Jan 27, 2007 1:46 amYour phpBB Version: 2.0.
phpBB Type: Integramod 141
MODs: Yes
Your knowledge: Basic Knowledge
Board URL: [url]http://[/url]
PHP Version:
MySQL Version:
What was done before the problem appeared?
Someone gave me some code that told googlebot to slow down, but I think I need more than this.
What was done to try to solve the problem?
De.scription and Message
I never thought I'd be saying this, but I'm very very close to banning all search spiders from my site. I keep upgrading and upgrading my hosting, but nothing ever seems to be enough. These spiders can be malicious when you're running a .script like integramod.
What can I do about this? I don't suppose I want to ban them all completely, but I want them all to SLOW down severely... like to the point where they're using my website no faster than any normal user.
I run a local forum and really have no need for any search engine help, but we have gained a couple users off of search so that's why I don't want to resort to banning yet.
Anyone have any good solutions for this?
Zac
phpBB Type: Integramod 141
MODs: Yes
Your knowledge: Basic Knowledge
Board URL: [url]http://[/url]
PHP Version:
MySQL Version:
What was done before the problem appeared?
Someone gave me some code that told googlebot to slow down, but I think I need more than this.
What was done to try to solve the problem?
De.scription and Message
I never thought I'd be saying this, but I'm very very close to banning all search spiders from my site. I keep upgrading and upgrading my hosting, but nothing ever seems to be enough. These spiders can be malicious when you're running a .script like integramod.
What can I do about this? I don't suppose I want to ban them all completely, but I want them all to SLOW down severely... like to the point where they're using my website no faster than any normal user.
I run a local forum and really have no need for any search engine help, but we have gained a couple users off of search so that's why I don't want to resort to banning yet.
Anyone have any good solutions for this?
Zac