Question

我有一个CSV文件，其数据如下所示：

54861,54850,Doe,John,NULL,-87.1181407064,30.3773576858
54862,54851,Doe,Linda,Lee,None,None

最后两列是经度和纬度

我正在使用mysql.connector插入数据库。它可以处理第一条记录，但是，由于最后两列都是浮点数，因此当到达第二条记录且其值设置为“ None”时，它会崩溃。

我以编程方式尝试将值设置为NULL，但也不会接受。

我尝试了几种不同的方法，但无法弄清楚。

这必须在Python中完成。

代码如下：

import sys
import mysql.connector
import csv
import os
from mysql.connector import Error
from mysql.connector import errorcode


#Specify the import file
try:


    inputCSV = 'geocoded_test.csv'

#Open the file and give it a handle

    csvFile = open(inputCSV, 'r')

#Create a reader object for the input file

    reader = csv.reader(csvFile, delimiter = ',')

except IOError as e:
    print("The input file ", inputCSV, " was not found", e)
    exit()


try:
   mydb = mysql.connector.connect(host='localhost',
                             database='wordpress',
                             user='wp_user',
                             password='XXXXXXXX!'
                             )

   mycursor = mydb.cursor()

except mysql.connector.Error as error:
    print( "Failed to connect to database: {}".format(error))
    exit()

try:

    record_count = 0

    for row in reader:
        contact_id,address_id,last_name, first_name, middle_name, longitude, latitude = row
        print(row)

# It is here that I want to convert to NULL. 

        if longitude == "None":
            longitude = -1.0
        if latitude == "None":
            latitude = -1.0

   #Update single record now

        mycursor.execute("""
            update civicrm_address
            set 
            geo_code_1 = %s,
            geo_code_2 = %s
        where
            id = %s 
        and
            location_type_id = %s 
        """,
        (latitude, longitude, address_id, 6)
        )
        mydb.commit()
        print(mycursor.rowcount)
        record_count +=1
        print("Record", record_count, " updated successfully")


finally:
    print(record_count, " records updated")
    #closing database connection.
    if(mydb.is_connected()):
        mydb.close()
        print("connection is closed")

Answer 1

一种选择是将LOAD DATA与自定义逻辑一起使用，该逻辑捕获None字符串值，然后将其转换为NULL：

LOAD DATA LOCAL INFILE 'your_file.csv'
INTO TABLE yourTable
FIELDS TERMINATED BY ','
LINES TERMINATED BY '\r\n' 
(col1, col2, last, first, middle, @lat, @lng)
SET lat = CASE WHEN @lat = 'None'
               THEN NULL
               ELSE CAST(@lat AS DECIMAL(10,8)) END,
SET lng = CASE WHEN @lng = 'None'
               THEN NULL
               ELSE CAST(@lng AS DECIMAL(10,8)) END;

我上面假设您的纬度列称为lat，而经度列称为lng。我只是为其他列虚拟了占位符名称，但您需要使用实际的列名称才能使上述加载工作。

将CSV文件中的列转换为NULL

1 个答案: