我有一些带有 robots.txt 的网站，Google 正在搜索我的 /css 和 /images 文件夹。为什么会这样？有什么方法可以阻止或消失，人们可以通过使用 .htaccess 添加 /css /images 来轻松访问我的站点 css 和 javascripts 是否有任何方法可以阻止这些端点的使用？
这是我的 robots.txt
User-agent: *
Disallow: /cgi-bin/
Disallow: /submit.php
Disallow: /config.php
Disallow: /.assets/
Disallow: /vendor/
Disallow: /images/
User-agent: rogerbot
Disallow: /tag/
User-agent: Pinterest
Allow: /
User-agent: Pinterestbot
Allow: /
User-agent: Pinterestbot/1.0
Allow: /
User-agent: Pinterest/0.2 (+https://www.pinterest.com/bot.html)
Allow: /
User-agent: Mozilla/5.0 (compatible; Pinterestbot/1.0; +https://www.pinterest.com/bot.html)
Allow: /
User-agent: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Pinterestbot/1.0; +https://www.pinterest.com/bot.html)
Allow: /
User-agent: Bingbot
Allow: /
User-agent: Slurp
Allow: /
User-agent: DuckDuckBot
Allow: /
User-agent: ia_archiver
Allow: /
User-agent: amazonbot
Allow: /
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
User-agent: NinjaBot
Disallow: /
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Mobile
Allow: /
#Disallow Seekbot - http://www.seekport.co.uk/seekbot/
User-agent: Seekport Crawler
Disallow: /
#Disallow Seekbot - http://www.seekport.co.uk/seekbot/
User-agent: Seekbot
Disallow: /
User-agent: Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)
Disallow: /
User-agent: Buck/2.2; (+https://app.hypefactors.com/media-monitoring/about.html)
Disallow: /
User-agent: Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
Disallow: /
#new bots info added
User-agent: Yandex
Disallow: /admin/*
User-agent: Yandex
Allow: /
User-agent: Mozilla/5.0 (compatible; Semanticbot/1.0; +http://sempi.tech/bot.html)
Allow: /
User-agent: Baiduspider
Allow: /
User-agent: Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: PetalBot
Disallow: /