Do Google Cloud IP's can be used by normally users?

Question

After few days of huge attacks what was come from China most of them, today i start to get a lot of hits from Google Cloud IP's ( they don't even follow robots.txt file ) can i know if this is Google Bots Crawler or is people using Google Cloud IP's to crawler the websites? If i block them can affect my google ranking?

Ips list:

August 3, 2017, 12:00 am - 107.178.194.117 - 6
August 3, 2017, 12:00 am - 107.178.194.96 - 6
August 3, 2017, 12:00 am - 107.178.194.115 - 6
August 3, 2017, 12:00 am - 107.178.194.115 - 5
August 3, 2017, 12:00 am - 107.178.194.96 - 5
August 3, 2017, 12:00 am - 107.178.194.96 - 4
August 3, 2017, 12:00 am - 107.178.194.113 - 12
August 3, 2017, 12:00 am - 107.178.194.113 - 11
August 3, 2017, 12:00 am - 107.178.194.99 - 4
August 3, 2017, 12:00 am - 107.178.194.127 - 5
August 3, 2017, 12:00 am - 107.178.194.117 - 5
August 3, 2017, 12:00 am - 107.178.194.127 - 4
August 3, 2017, 12:00 am - 107.178.194.115 - 4
August 3, 2017, 12:00 am - 107.178.194.127 - 3

Answer 1

我建议进入谷歌的网站管理员工具： https://www.google.com/webmasters/tools

在“抓取”部分，您可以确切了解Google抓取工具在您网站中的行为。

Google抓取工具，只能按照您在robots.txt google link中设置的路径进行操作。这是一个例子：

#all crawlers
User-agent: *
Disallow: /
User-agent: Googlebot
Allow: /
Disallow: /[dont-crawl-this-pad]/

#yahoo 
User-agent: Slurp
Allow: /
User-Agent: msnbot
Disallow: /

如果您怀疑某个网络正在robots.txt中定义的路径之外扫描该网站，您可以毫不犹豫地阻止它，以任何方式您都可以通过网站管理员工具了解抓取工具的状态，以便您的网站保持定位< / p>

希望此信息有所帮助。