robots.txt
# robots.txt
User-agent: *
Disallow: */admin/*
Disallow: */Edit/*
Disallow: */edit/*
Disallow: */SendEmailToResetPassword/*
Disallow: */GetBidsAndComments/*
Disallow: */User/GetLoginUserId/*
Disallow: */Account/SendEmailToResetPassword/*
Disallow: */DeleteConfirmed/*
使用robots.txt tester
中的google search console
进行测试。
允许的网址:
如何禁止这些网址?