如何在scrapy crawler中使用用户名/密码进行身份验证?

时间:2015-08-27 13:40:31

标签: python mongodb scrapy pymongo

我想在scrapy crawler中使用用户名/密码验证Pymongo客户端。使用此方法但收到错误

   class MongoDBPipeline(object):
        def __init__(self):
            connection = pymongo.MongoClient(settings['MONGODB_HOST'], settings['MONGODB_PORT'])
            connection.the_database.authenticate(settings['MONGODB_USERNAME'],settings['MONGODB_PASSWORD'],source='$external', mechanism='PLAIN')
            db = connection[settings['MONGODB_DATABASE']]
            self.collection = db[settings['MONGODB_COLLECTION']]

错误:

 connection.the_database.authenticate(settings['MONGODB_USERNAME'],settings['MONGODB_PASSWORD'],source='$external', mechanism='PLAIN')
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/database.py", line 988, in authenticate
    connect=True)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/mongo_client.py", line 397, in _cache_credentials
    sock_info.authenticate(credentials)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/pool.py", line 287, in authenticate
    auth.authenticate(credentials, self)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/auth.py", line 407, in authenticate
    auth_func(credentials, sock_info)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/auth.py", line 329, in _authenticate_plain
    sock_info.command(source, cmd)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/pool.py", line 184, in command
    codec_options, check, allowable_errors)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/network.py", line 54, in command
    helpers._check_command_response(response_doc, msg, allowable_errors)
  File "/home/nikhil/.local/lib/python2.7/site-packages/pymongo/helpers.py", line 188, in _check_command_response
    raise OperationFailure(msg % errmsg, code, response)
pymongo.errors.OperationFailure: command SON([('saslStart', 1), ('mechanism', 'PLAIN'), ('payload', Binary('\x00nikhil\x00password', 0)), ('autoAuthorize', 1)]) on namespace $external.$cmd failed: no such cmd: saslStart

我想验证我的代码以将其写入mongodb。

connection = pymongo.MongoClient("mongodb://localhost")

在哪里输入用户名和密码?

1 个答案:

答案 0 :(得分:1)

scrapy-mongodb易于使用。

但是,正常情况下,您需要从mongodb的python文档中重新引用authentication examples

- 参考 -

支持用户名和密码中的特殊字符

如果您的用户名或密码包含特殊字符(例如'/',''或'@'),则必须%xx转义它们以便在MongoDB URI中使用。 PyMongo使用unquote_plus()来解码它们。例如:

MongoClient('mongodb://user:' + password + '@127.0.0.1')