CODEWITHSUNDEEP
web-crawlerbotsgooglebot
Justmac
Justmac

Reputation: 550

Googlebot checks my comments every 7 seconds

Don't know where else to ask, but from one day to the other my Wordpress website gets 500 spam comments a day. No probem, I have added a spamblocker.

Now I have checked the visitors of my website and I noticed that googlebot checks /wp-comments-post.php 7 times a minute.

Is this a problem? And how to solve this?

Upvotes: 0

Views: 195

Answers (1)

eywu
eywu

Reputation: 2724

I wouldn't worry about it unless:

  1. The added load is slowing down your site
  2. Googlebot isn't getting to other pages because it's in some sort of loop (i.e. spider trap)

Social is a big initiative for Google this year and they've recently been seen crawling and indexing Facebook comments. So it make sense that they're also interested in Wordpress comments.

If you're really concerned or if it's impacting your site negatively, you can always block that page in your robots.txt, and Googlebot won't hit it anymore.

Upvotes: 2

Related Questions