CODEWITHSUNDEEP
indexingweb-crawler
u11
u11

Reputation: 97

Do crawlers skip content enclosed in the html small tag?

I was wondering whether the small tag indicates to crawlers that its content isn't relevant and so it will be skipped and not indexed.

Upvotes: 1

Views: 84

Answers (1)

Timothy Jones
Timothy Jones

Reputation: 22135

This is dependent on the crawler implementation.

I'm not aware of any formal or informal standard that small tags prevent content from being indexed, and it doesn't appear to be mentioned by major search engines when discussing control over what's indexed.

The original Google search engine gave extra weight to larger fonts - so you might expect a large font to be considered more relevant, but this doesn't mean that smaller fonts don't get indexed.

There is no standard for preventing parts of a page from being indexed. For an approach that might work on some engines, there is the class="robots-nocontent" which was introduced by (and I think only supported by) Yahoo - so unfortunately I wouldn't expect it to work across other engines.

Upvotes: 1

Related Questions