CODEWITHSUNDEEP
robots.txtgoogle-search-console
user2016348
user2016348

Reputation: 17

GWT says robots.txt is blocking resources - mine or theirs?

In Google Webmaster Tools when I 'Fetch as Google' it tells me there are 2 blocked resources which are blocked by robots.txt:

But I cannot see how these are blocked in my robots.txt, which contains the following:

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /category/
Disallow: /tag/
Disallow: /tools/

Any clues?

Upvotes: 1

Views: 794

Answers (1)

eywu
eywu

Reputation: 2724

You don't have to worry about those resources being blocked because those are on domains that you don't control and is being blocked by their robots.txt files.

Google Webmaster Tools is showing you that for the page you had it fetch, it can't see all the resources which is fairly common. Google and many large sites robots.txt many of their resources. (DoubleClick is a Google owned property)

As long as you can see the entirety of your content when you "fetch and render" you're in good shape.

Upvotes: 1

Related Questions