![]() ![]() To crawl all subdomains of a root domain (such as or ), then this configuration should be enabled. These will only be crawled to a single level and shown under the External tab.įor example, if is entered as the start URL, then other subdomains discovered in the crawl such as or will be treated as ‘external’, as well as other domains such as etc. Configuration > Spider > Crawl > Crawl All Subdomainsīy default the SEO Spider will only crawl the subdomain you crawl from and treat all other subdomains encountered as external sites. ![]()
0 Comments
Leave a Reply. |