从stdin的php postgresql pdo副本

时间:2012-02-13 14:08:05

标签: php postgresql pdo sqlbulkcopy

COPY table_name ( field1, field2, field3) FROM STDIN CSV;
1,2,"q w"
3,4,"a s"
5,6,d
\.

如何通过PDO执行此查询?

更新

问题是PDO驱动程序将此查询作为语句执行 例如,如果将其粘贴到pgAdmin中,则会引发错误 我需要在psql中执行它:

C:\Users\User>psql -e -h localhost -U postgres db_name
psql (9.1.2)
db_name=# COPY table_name ( field1, field2, field3) FROM STDIN CSV;
COPY table_name ( field1, field2, field3) FROM STDIN CSV;
Enter data to be copied followed by a newline.
End with a backslash and a period on a line by itself.
>> 1,2,"q w"
>> 3,4,"a s"
>> 5,6,d
>> \.

2 个答案:

答案 0 :(得分:5)

感谢this book

请注意,此处提供的功能有效地绕过安全限制,这是有原因的。您的函数应检查严格白名单条件下提供的文件路径和表。此示例也对SQL注入开放,因为它没有正确引用其输入。

创建执行COPY命令

的函数
CREATE OR REPLACE FUNCTION copy_from_csv_ignoring_security(table_name text, table_fieds text, file_path text, oids boolean DEFAULT false, header boolean DEFAULT false, delimeter text DEFAULT ','::text, "null" text DEFAULT ''::text, quote text DEFAULT '"'::text, escape text DEFAULT '"'::text, force_not_null text DEFAULT ''::text)
  RETURNS void AS
$BODY$

declare statement text;
begin

statement := 'COPY ' || table_name || ' (' || table_fieds || ') ' || 'FROM ''' || file_path || ''' WITH ';
IF oids THEN
 statement := statement || 'OIDS ';
end if;
statement := statement || 'DELIMITER ''' || delimeter || ''' ';
statement := statement || 'NULL ''' || "null" || ''' CSV ';
IF header THEN
 statement := statement || 'HEADER ';
end if;
statement := statement || 'QUOTE ''' || "quote" || ''' ';
statement := statement || 'ESCAPE ''' || "escape" || ''' ';
IF force_not_null <> '' THEN
statement := statement || 'FORCE NOT NULL ''' || force_not_null || ''' ';
end if;
execute statement;
end;
$BODY$
  LANGUAGE plpgsql VOLATILE SECURITY DEFINER
  COST 100;

赋予权限

revoke all on function copy_from_csv_ignoring_security(text, text, text, boolean, boolean, text, text, text, text, text) from public;
grant execute on function copy_from_csv_ignoring_security(text, text, text, boolean, boolean, text, text, text, text, text) to db_user;

从PHP执行

$dbh->exec('SELECT copy_from_csv_ignoring_security(...)');

=====如果版本&gt; = 9.1.7上面的技巧不起作用。 =====

<强>解决方案:

在运行此脚本的用户的主目录中创建文件.pgpass(避免密码提示)。

#.pgpass contents (chmod 600 - requred)    
host:port:db_name:user_name:password

创建php函数,执行meta-command

function executeMetaCommand($dbUser, $dbName, $dbPort, $command)
{    
    $command = sprintf(
        "psql -U %s -p %s -d %s -f - <<EOT\n%s\nEOT\n",
        $dbUser, $dbPort, $dbName, $command
    );
    $streams = array(
        array('pipe', 'r'),// stdin
        array('pipe', 'w'),// stdout
        array('pipe', 'w') // stderr
    );
    $process = proc_open($command, $streams, $pipes);
    if (!is_resource($process)) {
        throw new Exception("Cannot open process:\n$command");
    } else {
        list(, $stdout, $stderr) = $pipes;
        $error = stream_get_contents($stderr);
        fclose($stderr);
        if (strlen($error) > 0) {
            throw new Exception("Process error:\n$error");
        } else {
            $output = stream_get_contents($stdout);
            fclose($stdout);
            $returnCode = proc_close($process);
            if ($returnCode === -1) {
                throw new Exception("Process was completed incorrectly:\n$output");
            } else {
                return array(
                    $returnCode,
                    $output
                );
            }
        }
    }
}

//usage:
$command = sprintf("\\copy table(field1, field2) FROM '%s' WITH CSV", $filePath);
executeMetaCommand('postgres', 'test_db', '5432', $command);

答案 1 :(得分:0)

只需将输入行放入csv文件,例如input.csv,然后尝试以下操作:

<?php
$dbh = new PDO($dsn,$username,$pw);

$num_inserted=$dbh->exec("\copy table_name(field1,field2,field3) from /path/to/input.csv");

if($num_inserted===false)
{
  die("Unable to insert rows into table_name from input.csv\n");
}

echo("Inserted $num_inserted rows.\n");
?>