CODEWITHSUNDEEP
apache.htaccesssubdomaincpanelrobots.txt
John
John

Reputation: 3

How may i prevent search engines from crawling a subdomain on my website?

I have cPanel installed on my website.

  1. I went to the Domains section on cPanel

  2. I clicked on subdomains.

  3. I assigned the subdomain name (e.g : personal.mywebsite.com )

  4. It wanted me to assign document root folder also. I assigned mywebsite.com/personal

    if i create robots.txt in my website root(e.g : website.com)

    User-agent:

    Disallow: /personal/

Can it also block personal.mywebsite.com?

what should i do?

thanks

Upvotes: 0

Views: 359

Answers (1)

unor
unor

Reputation: 96607

When you want to block URLs on personal.example.com, visit http://personal.example.com/robots.txt (resp. https instead of http).

It doesn’t matter how your server organizes folders in the backend, it only matters which robots.txt is available when accessing this URL.

Upvotes: 1

Related Questions