Question

我正在探索beautifulsoup en django并且它工作正常，直到我添加了一个变量作为url（来自带有URLValidator的模型文本字段）

我在model_url之前添加了一个'https：//“+，但这也给出了一个错误。可能是什么问题？我google了很多，但没有任何效果...希望这不是一个双重问题..谢谢你前进！</ p>

这是我的model.py

class ScrapeUrl(models.Model):
product_title = models.CharField(max_length=255)
product_ean = models.CharField(max_length=25)
scrape_url = models.TextField(validators=[URLValidator()])
shop_price = models.DecimalField(max_digits=10, decimal_places=2)

def __str__(self):
    return self.product_title

def __unicode__(self):
    return unicode(self.product_title) or u''

这是我的views.py

def scrape_list_view(request):

model_url = ScrapeUrl.scrape_url

response = requests.get(model_url)

soup = bs4.BeautifulSoup(response.text)

price = soup.find("span", {"class": "promo-price"}).text

price_dot = price.replace(",",".").replace('-','0')
price_break = price_dot.replace('\r', '').replace('\n', '').replace(' ','')
price_data = float(price_break)

return render(request, 'scrape_list.html', {'price_data': price_data})

这是追溯

Environment:


Request Method: GET
Request URL: http://localhost:8000/app/

Django Version: 1.11.13
Python Version: 2.7.14
Installed Applications:
['django.contrib.admin',
 'django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.sessions',
 'django.contrib.messages',
 'django.contrib.staticfiles',
 'mathfilters',
 'scrapeapp']
Installed Middleware:
['django.middleware.security.SecurityMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.common.CommonMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware',
 'django.middleware.clickjacking.XFrameOptionsMiddleware']



Traceback:

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/django/core/handlers/exception.py" in inner
  41.             response = get_response(request)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/django/core/handlers/base.py" in _get_response
  187.                 response = self.process_exception_by_middleware(e, request)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/django/core/handlers/base.py" in _get_response
  185.                 response = wrapped_callback(request, *callback_args, **callback_kwargs)

File "/Users/sanderhegeman/scraper/scrapeapp/views.py" in scrape_list_view
  18.   response = requests.get(good_url)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/api.py" in get
  72.     return request('get', url, params=params, **kwargs)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/api.py" in request
  58.         return session.request(method=method, url=url, **kwargs)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/sessions.py" in request
  494.         prep = self.prepare_request(req)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/sessions.py" in prepare_request
  437.             hooks=merge_hooks(request.hooks, self.hooks),

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/models.py" in prepare
  305.         self.prepare_url(url, params)

File "/Users/sanderhegeman/scraper/lib/python2.7/site-packages/requests/models.py" in prepare_url
  379.             raise MissingSchema(error)

Exception Type: MissingSchema at /app/
Exception Value: Invalid URL '<django.db.models.query_utils.DeferredAttribute object at 0x10378b050>': No schema supplied. Perhaps you meant http://<django.db.models.query_utils.DeferredAttribute object at 0x10378b050>?

例外类型：MissingSchema / beautifulsoup

0 个答案: