Author: ZacFields » Mon Dec 04, 2006 12:06 pm
Yes I would have to confirm this did the trick.
At first I thought it was because I did a rebuild of the search database, but I think since the forums were disabled for about half an hour while I did that, the googlebot must have left temporarily. So when the forum came back on, initially it was fast but about 10 minutes later it started getting slow again.
This would be the FIRST thing I would suggest to someone who feels as though they are having a sudden problem with forum performance. This googlebot was causing my CPU usage to spike to 100% multiple times per minute and thus causing my pageloads to range anywhere from 5 seconds to 30 seconds.
In fact, I think I'm going to create another topic on here that will include all suggestions for speeding up a site, including this one. Always get into your admin panel and do a quick WHOIS of all the IP addresses that are not logged in. If you see any search engine bots, try a quick ban of that IP and see if that solves your speed issue...should do the trick instantly.
Look for that new topic soon, should help A LOT of people out as I suspect this may have been my problem all along. It would explain why when I transferred the domain name to my new VPS, suddenly my old shared host was running okay. Googlebot is on my site almost 24-7 and it is noteworthy that many MANY of the banned IP addresses in my "exploit attempts" section are googlebots. I have over 100 exploit attempts on my forum in the last 6 months...most of which I am noticing to be googlebot.
Somebody should fabricate a modification that would monitor how much resources are being consumed by each search engine bot. I knew googlebot was always on my site but I just never knew it was so resource-consuming.
Zac
Last edited by
ZacFields on Wed Dec 31, 1969 5:00 pm, edited 1 time in total.