带有列表的json_normalize JSON文件包含字典(包括示例)

时间:2018-07-08 22:23:35

标签: python json python-3.x pandas normalize

这是我正在处理的2条记录的示例json文件:

[{"Time":"2016-01-10",
"ID"
:13567,
"Content":{
    "Event":"UPDATE",
    "Id":{"EventID":"ABCDEFG"},
    "Story":[{
        "@ContentCat":"News",
        "Body":"Related Meeting Memo: Engagement with target firm for potential M&A.  Please be on call this weekend for news updates.",
        "BodyTextType":"PLAIN_TEXT",
        "DerivedId":{"Entity":[{"Id":"Amy","Score":70}, {"Id":"Jon","Score":70}]},
        "DerivedTopics":{"Topics":[
                            {"Id":"Meeting","Score":70},
                            {"Id":"Performance","Score":70},
                            {"Id":"Engagement","Score":100},
                            {"Id":"Salary","Score":70},
                            {"Id":"Career","Score":100}]
                        },
        "HotLevel":0,
        "LanguageString":"ENGLISH",
        "Metadata":{"ClassNum":50,
                    "Headline":"Attn: Weekend",
                    "WireId":2035,
                    "WireName":"IIS"},
        "Version":"Original"}
                ]},
"yyyymmdd":"20160110",
"month":201601},
{"Time":"2016-01-12",
"ID":13568,
"Content":{
    "Event":"DEAL",
    "Id":{"EventID":"ABCDEFG2"},
    "Story":[{
        "@ContentCat":"Details",
        "Body":"Test email contents",
        "BodyTextType":"PLAIN_TEXT",
        "DerivedId":{"Entity":[{"Id":"Bob","Score":100}, {"Id":"Jon","Score":70}, {"Id":"Jack","Score":60}]},
        "DerivedTopics":{"Topics":[
                            {"Id":"Meeting","Score":70},
                            {"Id":"Engagement","Score":100},
                            {"Id":"Salary","Score":70},
                            {"Id":"Career","Score":100}]
                        },
        "HotLevel":0,
        "LanguageString":"ENGLISH",
        "Metadata":{"ClassNum":70,
                    "Headline":"Attn: Weekend",
                    "WireId":2037,
                    "WireName":"IIS"},
        "Version":"Original"}
                ]},
"yyyymmdd":"20160112",
"month":201602}]

我正在尝试获取实体ID级别的数据帧(从记录1和AmyJon,{{提取BobJon 1}}(来自记录2)。

但是我早早就遇到了错误。到目前为止,这是我的代码,假设示例json被保存为Jack

sample.json

导致此错误:

data = json.load(open('sample.json'))
test = json_normalize(data, record_path=['Content', 'Story'])

我怀疑是因为Content.Story实际上是一个包含字典的列表,而不是字典本身。但是我不清楚如何真正克服这个问题?

编辑:为澄清起见,我最终尝试达到实体ID的级别(内容>故事> DerivedID>实体> ID)。正在显示Content.Story代码示例,只是为了说明我现在在解决这个问题的位置。

1 个答案:

答案 0 :(得分:2)

json_normalize(data, record_path=[['Content', 'Story']])

应该可以。