Question

这是我的代码：

#!/usr/bin/python

# Import modules
import pandas as pd
import requests
import numpy as np

# Set ipython's max row display
pd.set_option('display.max_row', 1000)

# Insert your CrisisNET API key
api_key = xxxxxxxxxxxxxxx

# Insert your CrisisNET request API
api_url = 'http://api.crisis.net/item?sources=twitter&tags=weather'

# Create the request header
headers = {'Authorization': 'Bearer ' + api_key}

# Define how many data points you want
total = 10000

# Create a dataframe where the request data will go
df = pd.DataFrame()

# Define a function called get data,
def get_data(offset=0, limit=100, df=None):
    # create a variable called url, which has the request info,
    url = api_url + '&offset=' + str(offset) + '&limit=' + str(limit)
    # a variable called r, with the request data,
    r = requests.get(url, headers=headers)
    # convert the request data into a dataframe,
    x = pd.DataFrame(r.json())



    # expand the dataframe
    x = x['data'].apply(pd.Series)
    # add the dataframe's rows to the main dataframe, df, we defined outside the function
    df = df.append(x, ignore_index=True)

    # then, if the total is larger than the request limit plus offset,
    if total > offset + limit:
        # run the function another time
        return get_data(offset + limit, limit, df)
    # but if not, end the function
    return df

# Run the function
df = get_data(df=df)

# Check the number of data points retrieved
len(df)

# Check for duplicate data points
df['id'].duplicated().value_counts()

# Drop all duplicate data points
df = df.dropna(how='all')

df.to_csv('TwitterWeather.csv')

# View the first 10 data points
print df.head()

我收到以下错误：

UnicodeEncodeError: 'ascii' codec can't encode character u'\xf3' in position 16: ordinal not in range(128)

我该如何解决？

Answer 1

正如其他人所说，你有一个unicode字符串。如果您尝试将其写入文件，则此类字符串将返回错误。将dataFrame保存到csv文件时，似乎会发生错误。

要解决此问题，首先需要将字符串转换为unicode。你可以写一个函数，如：

def change_text(text):
    return text.encode('utf-8')  # assuming the encoding is UTF-8

然后，您可以将其应用于具有unicode字符的列：

df['<column_name>'] = df.apply(change_text,axis=1)

UnicodeEncodeError：＆＃39; ascii＆＃39;编解码器无法对字符u＆＃39; \ xf3＆＃39;进行编码。位置16：序数不在范围内（128）

1 个答案: