Joomla Templates Club 406,261 posts

[earthson Friend earthsonJoin date: May 2008Posts: 162Downloads:0Uploads:21 Thanks: 17 Thanked: 7 times in 1 posts]

#488298

I think I finally tracked down the problem. Robots. GoogleBot and Bingbot have been mercilessly crawling my site. I just switched over from a Liferay website to joomla, and they were trying to track down the millions of cruddy liferay urls. For some reason, none of them were going to the 404 page…they were all being redirected to the homepage. I guess that would explain the extreme cpu usage on index.php

I fixed the settings so that hey are redirected to the 404. And, I slowed down the bots with a crawl-delay. Hopefully they will settle down soon.

Anyway, thanks for your suggestions 🙂

[earthson Friend earthsonJoin date: May 2008Posts: 162Downloads:0Uploads:21 Thanks: 17 Thanked: 7 times in 1 posts]

#488343

Definitely solved the problem. Here are the new stats as of this morning:

Stats for 30 Mar 2013:
———————————
CPU Usage – %1.00
MEM Usage – %0.48
Number of MySQL procs (average) – 0.08
Top Process %CPU 36.00 /usr/bin/php /home/…/public_html/index.php
Top Process %CPU 17.00 /usr/bin/php /home/…/public_html/…/index.php
Top Process %CPU 8.00 /usr/bin/php /home/…/public_html/…/index.php

[Manos Moderator ManosJoin date: February 2014Posts: 2806Downloads:46Uploads:56 Thanks: 200 Thanked: 633 times in 576 posts]

#488349

So the main problem was the bots ?

[earthson Friend earthsonJoin date: May 2008Posts: 162Downloads:0Uploads:21 Thanks: 17 Thanked: 7 times in 1 posts]

#488351

I think the ENTIRE problem was the bots. They were crazy busy on my site.

[Author]

Posts