Django的计数在Oracle中失败了

时间:2013-10-21 19:47:48

标签: python sql django oracle

我正在尝试使用此模型对oracle数据库进行查询:

class FCSTrunkValidation(Validation):
    card_transaction = models.CharField(max_length=10, db_column='card_trnsctn_seq', primary_key=True)
    card_number = models.CharField(max_length=16, db_column='card_num')
    use_date = models.CharField(max_length=14, db_column='use_date')
    device = models.ForeignKey('TrunkDevice', db_column='device_id')
    agency_id = models.CharField(max_length=3, db_column='agency_id')

这个查询:

# day is a datetime object
qs = FCSTrunkValidation.oracle_objects.all()
qs = qs.filter(use_date__startswith=day.strftime('%Y%m%d'))

当我qs.count()时,我得到了这个:

...
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/models/query.py", line 93, in __repr__
    data = list(self[:REPR_OUTPUT_SIZE + 1])
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/models/query.py", line 108, in __len__
    self._result_cache.extend(self._iter)
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/models/query.py", line 317, in iterator
    for row in compiler.results_iter():
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 775, in results_iter
    for rows in self.execute_sql(MULTI):
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 840, in execute_sql
    cursor.execute(sql, params)
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/backends/util.py", line 41, in execute
    return self.cursor.execute(sql, params)
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/backends/oracle/base.py", line 717, in execute
    six.reraise(utils.DatabaseError, utils.DatabaseError(*tuple(e.args)), sys.exc_info()[2])
  File "/home/diegueus9/dev/odm/local/lib/python2.7/site-packages/django/db/backends/oracle/base.py", line 710, in execute
    return self.cursor.execute(query, self._param_generator(params))
DatabaseError: ORA-02395: exceeded call limit on IO usage

但是,如果我使用squirrel客户端执行查询,我得到了数字,那么django可能会做额外的查询来引发错误吗?我怎样才能让计数与django一起工作?

我虽然使用了原始的sql,但后来我在%部分LIKE中逃避问题

软件包版本

的Python == 2.7.4 Django的== 1.5.4 CX-甲骨文== 5.1.2 6 == 1.4.1

更新20131023

根据@alko的建议,我在django.db.backends.oracle.base第709行添加了一个打印声明,如下所示:

print query, self._param_generator(params)

然后我用Squirrel中的那些参数执行了那个查询,并且仍然得到了计数。

我的手动查询是:

select count(*) from TBAAD300 where AGENCY_ID=201 and USE_DATE LIKE '20130930%'

django使用的查询是:

SELECT COUNT(*) FROM "TBAAD300" WHERE ("TBAAD300"."AGENCY_ID" = :arg0  AND "TBAAD300"."USE_DATE" LIKE TRANSLATE(:arg1 USING NCHAR_CS) ESCAPE TRANSLATE('\' USING NCHAR_CS) )

[u'201', u'20130930%']作为参数

然后我在Squirrel中执行相同的查询,结果是130410,但是当django执行时,会引发相同的错误,print语句打印的完整查询是:

ALTER SESSION SET NLS_TERRITORY = 'AMERICA' []
ALTER SESSION SET NLS_DATE_FORMAT = 'YYYY-MM-DD HH24:MI:SS' NLS_TIMESTAMP_FORMAT = 'YYYY-MM-DD HH24:MI:SS.FF' TIME_ZONE = 'UTC' []
SELECT 1 FROM DUAL WHERE DUMMY LIKE TRANSLATE(:arg0 USING NCHAR_CS) ESCAPE TRANSLATE('\' USING NCHAR_CS) [u'X']
SELECT COUNT(*) FROM "TBAAD300" WHERE ("TBAAD300"."AGENCY_ID" = :arg0  AND "TBAAD300"."USE_DATE" LIKE TRANSLATE(:arg1 USING NCHAR_CS) ESCAPE TRANSLATE('\' USING NCHAR_CS) ) [u'201', u'20130930%']

1 个答案:

答案 0 :(得分:0)

Oracle是您的prod db吗? ORA-02395意味着IO限制,https://forums.oracle.com/thread/655458,似乎您的count()查询导致对db中的大型表进行完全扫描,并限制每个查询的块读取。

我建议您重新考虑您的数据模型,是否可以将DateField用于use_date字段,并用filter(use_date__gte = ..., use_date___lte = ...)替换您的查询?在这种情况下,您可以通过在use_date字段上添加索引来大幅提高性能和IO使用率,因为如果合适,计数和类似查询都可以使用它。

UPDATE(此处添加到精细格式SQL)

您的Oracle DBMS版本是什么?您是否在相同的用户凭据下运行语句?什么是您的用户的资源限制(this可以帮助)。

要检查资源消耗指标是什么,您还可以在sql客户端中运行以下命令:

exec runstats_pkg.rs_start;
<YOUR statement>
exec runstats_pkg.rs_stop;
select * from stats where name like '%session logical reads%';
select * from stats where name like '%consistent gets%';

执行计划也可能很方便

set autotrace on;
<YOUR STATEMENT>
set autotrace off;

here

所述