使用Elasticsearch的Django haystack在重建索引时无法找到数据库

时间:2015-07-30 19:29:58

标签: django postgresql amazon-web-services elastic-beanstalk django-haystack

我将Haystack添加到已成功部署到AWS ElasticBeanstalk实例的Django项目中。当我运行rebuild_index时,Haystack在本地工作但在AWS环境中工作。我收到这个错误:

Failed to clear Elasticsearch index: ConnectionError(('Connection aborted.', error(111, 'Connection refused'))) caused by: ProtocolError(('Connection aborted.', error(111, 'Connection refused')))
All documents removed.
ERROR:root:Error updating api using default 
Traceback (most recent call last):
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 188, in handle_label
    self.update_backend(label, using)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 219, in update_backend
    total = qs.count()
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/models/query.py", line 318, in count
    return self.query.get_count(using=self.db)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 464, in get_count
    number = obj.get_aggregation(using, ['__count'])['__count']
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 445, in get_aggregation
    result = compiler.execute_sql(SINGLE)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 838, in execute_sql
    cursor = self.connection.cursor()
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 162, in cursor
    cursor = self.make_debug_cursor(self._cursor())
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 135, in _cursor
    self.ensure_connection()
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 130, in ensure_connection
    self.connect()
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/utils.py", line 97, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 130, in ensure_connection
    self.connect()
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 119, in connect
    self.connection = self.get_new_connection(conn_params)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/django/db/backends/postgresql_psycopg2/base.py", line 176, in get_new_connection
    connection = Database.connect(**conn_params)
  File "/opt/python/run/venv/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 164, in connect
    conn = _connect(dsn, connection_factory=connection_factory, async=async)
OperationalError: could not connect to server: Connection refused
        Is the server running on host "localhost" (127.0.0.1) and accepting
        TCP/IP connections on port 5432?

似乎Haystack正在尝试连接到我本地设置中指定的数据库,而不是我专门为我的AWS ElasticBeanstalk环境指定的Postgres RDS,即使“DATABASE”设置在AWS上用于./manage.py loaddata

    if 'RDS_DB_NAME' in os.environ:
        DATABASES = {
            'default': {
                'ENGINE': 'django.db.backends.postgresql_psycopg2',
                'NAME': os.environ['RDS_DB_NAME'],
                'USER': os.environ['RDS_USERNAME'],
                'PASSWORD': os.environ['RDS_PASSWORD'],
                'HOST': os.environ['RDS_HOSTNAME'],
                'PORT': os.environ['RDS_PORT'],
            }
        }
    else:
        DATABASES = {
            'default': {
                'ENGINE': 'django.db.backends.postgresql_psycopg2',
                'NAME': 'hhwc',
                'HOST': 'localhost',
                'PORT': '5432',
            }
        }

这个'DATABASE'设置中有什么问题,或者Haystack是否在其他地方查找它应该连接到的数据库的位置以生成索引?

欢迎任何帮助解决此问题的帮助。提前谢谢。

3 个答案:

答案 0 :(得分:0)

来自answer to another SO question

  

环境变量不是在virtualenv中设置的,而是由另一个脚本设置的。首先,你必须激活virualenv。

     

来源/ opt / python / run / venv / bin / activate

     

然后你需要通过激活当前'中的env脚本来加载变量。 。目录

     

来源/ opt / python / current / env

     

Beanstalk RDS变量现已设置并可供您在SSH中执行的任何脚本使用。'

答案 1 :(得分:0)

错误与数据库无关,但与haystack配置无关。检查您在那里使用的网址。确保在主机名后面使用:80,因为如果你没有明确地给出一个并且AWS在端口80中设置它,则haystack默认为端口9200。

答案 2 :(得分:0)

错误基本上是,你的django项目无法连接到亚马逊弹性搜索实例。 这是一种与aws elasticsearch连接的方法

首先,您需要使用

安装requests_aws4auth
 sudo pip install requests_aws4auth

现在您需要连接amazon elasticsearch实例

 from requests_aws4auth import AWS4Auth
 from elasticsearch import Elasticsearch, RequestsHttpConnection
 import elasticsearch
 host = 'YOUR_HOST without putting port number'
 awsauth = AWS4Auth('YOUT_ACCESS_KEY', 'YOUR_SECRET_KEY', 'REGION', 'es')

 HAYSTACK_CONNECTIONS = {
    'default': {
     'ENGINE': 'haystack.backends.elasticsearch_backend.ElasticsearchSearchEngine',
     'URL': host,
     'INDEX_NAME': 'haystack',
     'KWARGS': {
         'port':443,
         'http_auth': awsauth,
         'use_ssl': True,
         'verify_certs': True,
         'connection_class': elasticsearch.RequestsHttpConnection,
     }
 },

}

对于仍然会遇到问题的人,您需要使用以下

创建索引
 curl -XPUT 'Your_AWS_ELASTICSEARCH_URL/haystack/'