如何找出复制的行数?

时间:2014-11-05 18:49:40

标签: ruby postgresql pg rowcount postgresql-copy

我正在运行Postgres数据库并在ruby中使用COPY命令将数据加载到临时表中。

它看起来像这样:

@conn = PG.connect(dbname: 'load_test')
res = @conn.async_exec <<-QUERY
  COPY tmp_inventory FROM '#{infile_location}' CSV HEADER DELIMITER '|'
QUERY

有一条INFO日志消息,其中包含添加的总行数。我怎样才能从ruby中以编程方式获得这个数字?

2 个答案:

答案 0 :(得分:1)

您可以在Postgres中执行此操作,或直接从Ruby中的Postgres界面获取它:

使用Ruby

更具体地说是班级PGresult

我不是Ruby专家,但研究文档herehere,似乎方法cmd_tuples仅适用于INSERT|DELETE|UPDATE|MOVE|FETCH

还有常量PGRES_COPY_OUT PGRES_COPY_IN (针对手头的情况)。似乎the method result_status returns the respective value

  

返回查询的状态。状态值是以下之一:

PGRES_EMPTY_QUERY
PGRES_COMMAND_OK
PGRES_TUPLES_OK
PGRES_COPY_OUT
PGRES_COPY_IN
PGRES_BAD_RESPONSE
PGRES_NONFATAL_ERROR
PGRES_FATAL_ERROR
PGRES_COPY_BOTH

因此,在您的示例中,您应该通过以下方式获得所需的值:

res.result_status

使用Postgres

您可以使用PL / pgSQL函数以编程方式访问由COPY处理的行数(需要9.2+版本):

答案 1 :(得分:1)

Erwin Brandstetter走在正确的轨道上。尽管Ruby API文档目前说的是(它需要更新),但PG::Result#cmd_tuples确实可以使用COPY命令,至少从PostgreSQL 9.6.3开始。问题被提出时可能没有,但the libpq documentation for PQcmdTuples现在包含COPY,所以我将更新Ruby API的文档来反映这一点。

这是one of the examples in the source's sample/ directory的修改版本,使用围绕PG::Connection#copy_data的{​​{1}} API的libpq包装器方法说明了这一点:

COPY

当它运行时输出:

require 'pg'
require 'stringio'

$stderr.puts "Opening database connection ..."
conn = PG.connect( dbname: 'test' )

conn.exec( <<END_SQL )
DROP TABLE IF EXISTS logs;
CREATE TABLE logs (
    client_ip inet,
    username text,
    ts timestamp,
    request text,
    status smallint,
    bytes int
);
END_SQL

csv_io = StringIO.new( <<"END_DATA" )
"127.0.0.1","","30/Aug/2010:08:21:24 -0700","GET /manual/ HTTP/1.1",404,205
"127.0.0.1","","30/Aug/2010:08:21:24 -0700","GET /favicon.ico HTTP/1.1",404,209
"127.0.0.1","","30/Aug/2010:08:21:24 -0700","GET /favicon.ico HTTP/1.1",404,209
"127.0.0.1","","30/Aug/2010:08:22:29 -0700","GET /manual/ HTTP/1.1",200,11094
"127.0.0.1","","30/Aug/2010:08:22:38 -0700","GET /manual/index.html HTTP/1.1",200,725
"127.0.0.1","","30/Aug/2010:08:27:56 -0700","GET /manual/ HTTP/1.1",200,11094
"127.0.0.1","","30/Aug/2010:08:27:57 -0700","GET /manual/ HTTP/1.1",200,11094
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/index.html HTTP/1.1",200,7709
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/images/feather.gif HTTP/1.1",200,6471
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/images/left.gif HTTP/1.1",200,60
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/style/css/manual.css HTTP/1.1",200,18674
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/style/css/manual-print.css HTTP/1.1",200,13200
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/images/favicon.ico HTTP/1.1",200,1078
"127.0.0.1","","30/Aug/2010:08:28:06 -0700","GET /manual/style/css/manual-loose-100pc.css HTTP/1.1",200,3065
"127.0.0.1","","30/Aug/2010:08:28:14 -0700","OPTIONS * HTTP/1.0",200,0
"127.0.0.1","","30/Aug/2010:08:28:15 -0700","OPTIONS * HTTP/1.0",200,0
"127.0.0.1","","30/Aug/2010:08:28:47 -0700","GET /manual/mod/directives.html HTTP/1.1",200,33561
"127.0.0.1","","30/Aug/2010:08:28:53 -0700","GET /manual/mod/mpm_common.html HTTP/1.1",200,67683
"127.0.0.1","","30/Aug/2010:08:28:53 -0700","GET /manual/images/down.gif HTTP/1.1",200,56
"127.0.0.1","","30/Aug/2010:08:28:53 -0700","GET /manual/images/up.gif HTTP/1.1",200,57
"127.0.0.1","","30/Aug/2010:09:19:58 -0700","GET /manual/mod/mod_log_config.html HTTP/1.1",200,28307
"127.0.0.1","","30/Aug/2010:09:20:19 -0700","GET /manual/mod/core.html HTTP/1.1",200,194144
"127.0.0.1","","30/Aug/2010:16:02:56 -0700","GET /manual/ HTTP/1.1",200,11094
"127.0.0.1","","30/Aug/2010:16:03:00 -0700","GET /manual/ HTTP/1.1",200,11094
"127.0.0.1","","30/Aug/2010:16:06:16 -0700","GET /manual/mod/mod_dir.html HTTP/1.1",200,10583
"127.0.0.1","","30/Aug/2010:16:06:44 -0700","GET /manual/ HTTP/1.1",200,7709
END_DATA

### You can test the error case from the database side easily by
### changing one of the numbers at the end of one of the above rows to
### something non-numeric like "-".

$stderr.puts "Running COPY command with data ..."
buf = ''
conn.transaction do
    res = conn.copy_data( "COPY logs FROM STDIN WITH csv" ) do
        $stderr.print "Sending lines... "
        csv_io.each_line.with_index do |buf, i|
            $stderr.print "#{i + 1} "
            conn.put_copy_data( buf )
        end
        $stderr.puts "done."
    end
    $stderr.puts "Result of COPY is: %s" % [ res.res_status(res.result_status) ]
    $stderr.puts "  tuples copied: %p" % [ res.cmd_tuples ]
end

conn.finish

$ ruby sample/copyfrom.rb Opening database connection ... Running COPY command with data ... Sending lines... 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 done. Result of COPY is: PGRES_COMMAND_OK tuples copied: 26 方法只返回整数结果状态代码,PG::Result#result_status / PGRES_COPY_OUT由低级PGRES_COPY_IN API使用,因此它们在正常情况。