googlebot正在抓取,我的服务器向我发送了太多邮件

时间:2013-08-12 06:52:35

标签: http web web-crawler googlebot

我被googlebot淹没了,我从托管服务器那里得到了大约25封邮件,说一些没有意义的错误。其中之一就是:

[Django] ERROR (EXTERNAL IP): Internal Server Error: /location/date-in-modersohnbrucke/101/

 File "/home/benjaminvisser/django-locate/django/core/handlers/base.py", line 111, in get_response
response = callback(request, *callback_args, **callback_kwargs)

 File "/home/benjaminvisser/locate/locate/home/views.py", line 462, in location
 location = Location.objects.get(id=lid)

 File "/home/benjaminvisser/django-locate/django/db/models/manager.py", line 131, in get
return self.get_query_set().get(*args, **kwargs)

 File "/home/benjaminvisser/django-locate/django/db/models/query.py", line 366, in get
% self.model._meta.object_name)

DoesNotExist: Location matching query does not exist.

但是这个网址在我的网页上不再存在,为什么谷歌仍在抓取它们?有没有办法说谷歌这些网址不存在任何东西?

0 个答案:

没有答案