robots.txt允许所有网址

时间:2019-07-12 19:59:24

标签: seo robots.txt

robots.txt

# robots.txt

User-agent: *
Disallow: */admin/*

Disallow: */Edit/*
Disallow: */edit/*

Disallow: */SendEmailToResetPassword/*

Disallow: */GetBidsAndComments/*
Disallow: */User/GetLoginUserId/*

Disallow: */Account/SendEmailToResetPassword/*
Disallow: */DeleteConfirmed/*

使用robots.txt tester中的google search console进行测试。

允许的网址:

  1. http://www.exp.com/ClassifiedAds/DeleteConfirmed/22c1c7b6-e114-4f29-8844-d3ae5e89950b

    1. http://www.exp.com/Account/SendEmailToResetPassword?ReturnUrl=%2Fitem%2Fhome-appliances-80b30b83-7ba9-4565-9e44-0d40d3f7f1d6

    2. http://www.exp.com/api/Electronic/GetBidsAndComments?id=51426&_=1548892800023

如何禁止这些网址?

0 个答案:

没有答案