Question

我想将数据从.txt导入数据框。我无法使用经典pd.read_csv导入它，而使用不同类型的sep会引发错误。我要导入的数据Cell_Phones_&_Accessories.txt.gz是一种格式。

product/productId: B000JVER7W
product/title: Mobile Action MA730 Handset Manager - Bluetooth Data Suite
product/price: unknown
review/userId: A1RXYH9ROBAKEZ
review/profileName: A. Igoe
review/helpfulness: 0/0
review/score: 1.0
review/time: 1233360000
review/summary: Don't buy!
review/text: First of all, the company took my money and sent me an email telling me the product was shipped. A week and a half later I received another email telling me that they are sorry, but they don't actually have any of these items, and if I received an email telling me it has shipped, it was a mistake.When I finally got my money back, I went through another company to buy the product and it won't work with my phone, even though it depicts that it will. I have sent numerous emails to the company - I can't actually find a phone number on their website - and I still have not gotten any kind of response. What kind of customer service is that? No one will help me with this problem. My advice - don't waste your money!

product/productId: B000JVER7W
product/title: Mobile Action MA730 Handset Manager - Bluetooth Data Suite
product/price: unknown
....

Answer 1

您可以使用jen进行分隔，然后按前:和pivot进行分隔：

df = pd.read_csv('Cell_Phones_&_Accessories.txt', sep='¥', names=['data'], engine='python')

df1 = df.pop('data').str.split(':', n=1, expand=True)
df1.columns = ['a','b']

df1 = df1.assign(c=(df1['a'] == 'product/productId').cumsum())
df1 = df1.pivot('c','a','b')

带有defaultdict和DataFrame构造函数的Python解决方案可提高性能：

from collections import defaultdict

data = defaultdict(list)
with open("Cell_Phones_&_Accessories.txt") as f:
  for line in f.readlines():
      if len(line) > 1:
          key, value = line.strip().split(':', 1)
          data[key].append(value)

df = pd.DataFrame(data)

熊猫，使用read_csv导入类似JSON的文件

1 个答案: