在Python中更新复杂的JSON对象

时间:2016-05-06 14:12:08

标签: python json mongodb python-3.x

我正在使用Python(v3.5)抓取一些复杂的MongoDB文档,我应该更新其中散布在对象周围的一些值,并且在结构中没有特定的模式并将其保存回不同的MongoDB采集。该对象如下所示:

# after json.loads(mongo_db_document) my dict looks like this
notification = {
    '_id': '570f934f45213b0d14b1256f',
    'key': 'receipt',
    'label': 'Delivery Receipt',
    'version': '0.0.1',
    'active': True,
    'children': [
        {
            'key': 'started',
            'label': 'Started',
            'children': [
                'date',
                'time',
                'offset'
            ]
        },
        {
            'key': 'stop',
            'label': 'Ended',
            'children': [
                'date',
                'time',
                'offset'
            ]
        },
        {
            'label': '1. Particulars',
            'template': 'formGroup',
            'children': [
                {
                    'children': [
                        {
                            'key': 'name',
                            'label': '2.1 Name',
                            'value': '********** THIS SHOULD BE UPDATED **********',
                            'readonly': 'true'
                        },
                        {
                            'key': 'ims_id',
                            'label': '2.2 IMS Number',
                            'value': '********** THIS SHOULD BE UPDATED **********',
                            'readonly': 'true'
                        }
                    ]
                },
                {
                    'children': [
                        {
                            'key': 'type',
                            'readonly': '********** THIS SHOULD BE UPDATED **********',
                            'label': '2.3 Type',
                            'options': [
                                {
                                    'label': 'Passenger',
                                    'value': 'A37'
                                },
                                {
                                    'label': 'Cargo',
                                    'value': 'A35'
                                },
                                {
                                    'label': 'Other',
                                    'value': '********** THIS SHOULD BE UPDATED **********'
                                }
                            ]
                        }
                    ]
                }
            ]
        },
        {
            'template': 'formGroup',
            'key': 'waste',
            'label': '3. Waste',
            'children': [
                {
                    'label': 'Waste',
                    'children': [
                        {
                            'label': 'Plastics',
                            'key': 'A',
                            'inputType': 'number',
                            'inputAttributes': {
                                'min': 0
                            },
                            'value': '********** THIS SHOULD BE UPDATED **********'
                        },
                        {
                            'label': 'B. Oil',
                            'key': 'B',
                            'inputType': 'number',
                            'inputAttributes': {
                                'min': 0
                            },
                            'value': '********** THIS SHOULD BE UPDATED **********'
                        },
                        {
                            'label': 'C. Operational',
                            'key': 'C',
                            'inputType': 'number',
                            'inputAttributes': {
                                'min': 0
                            },
                            'value': '********** THIS SHOULD BE UPDATED **********'
                        }
                    ]
                }
            ]
        },
        {
            'template': 'formRow',
            'children': [
                'empty',
                'signature'
            ]
        }
    ],
    'filter': {
        'timestamp_of_record': [
            'date',
            'time',
            'offset'
        ]
    }
}

我最初的想法是将占位符(例如$var_name)放在我需要更新值的位置,并使用Python string.Template加载字符串,但不幸的是,这种方法会破坏很多由于某种原因,东西给同一个MongoDB文档的其他用户。

是否有一种解决方案可以简单地修改这种类型的对象而不需要"硬编码"找到我需要更新的值的路径?

3 个答案:

答案 0 :(得分:1)

不确定我是否理解正确,但这会动态找到所有键"值"和" readonly"并打印出解决这些字段的路径。

def findem(data, trail):
    if isinstance(data, dict):
        for k in data.keys():
            if k in ('value', 'readonly'):
                print("{}['{}']".format(trail, k))
            else:
                findem(data[k], "{}['{}']".format(trail, k))
    elif isinstance(data, list):
        for k in data:
            findem(k, '{}[{}]'.format(trail, data.index(k)))

if __name__ == '__main__':
    findem(notification, 'notification')

notification['children'][2]['children'][0]['children'][0]['readonly']
notification['children'][2]['children'][0]['children'][0]['value']
notification['children'][2]['children'][0]['children'][1]['readonly']
notification['children'][2]['children'][0]['children'][1]['value']
notification['children'][2]['children'][1]['children'][0]['readonly']
notification['children'][2]['children'][1]['children'][0]['options'][0]['value']
notification['children'][2]['children'][1]['children'][0]['options'][1]['value']
notification['children'][2]['children'][1]['children'][0]['options'][2]['value']
notification['children'][3]['children'][0]['children'][0]['value']
notification['children'][3]['children'][0]['children'][1]['value']
notification['children'][3]['children'][0]['children'][2]['value']

答案 1 :(得分:1)

几年前我写过这个小脚本 - 我用它来查找一些非常长且令人不安的JSON中的条目。不可否认,这不是很美,但也许在你的情况下可能会有所帮助吗? 您可以在Bitbucket上找到该脚本,herehere是代码)。 不幸的是,没有记录;当时我并不是真的相信别人会用它,我想 无论如何,如果您想尝试一下,请将脚本保存在您的工作目录中,然后使用以下内容:

from RecursiveSearch import Retriever

def alter_data(json_data, key, original, newval):
    '''
    Alter *all* values of said keys
    '''
    retr = Retriever(json_data)
    for item_no, item in enumerate(retr.__track__(key)): # i.e. all 'value'
        # Pick parent objects with a last element False in the __track__() result,
        # indicating that `key` is either a dict key or a set element
        if not item[-1]: 
            parent = retr.get_parent(key, item_no)
            try:
                if parent[key] == original:
                    parent[key] = newval
            except TypeError:
                # It's a set, this is not the key you're looking for
                pass

if __name__ == '__main__':
    alter_data(notification, key='value', 
               original = '********** THIS SHOULD BE UPDATED **********',
               newval = '*UPDATED*')

不幸的是,正如我所说的那样,脚本没有很好的记录,所以如果你想尝试它并需要更多的信息,我很乐意提供它。

答案 2 :(得分:0)

将另一个列表添加到JSON对象。该列表中的每个项目都是导致要更改的值的键列表。一个这样的列表的示例是:['children', 2, 'children', 'children', 0, 'value']。 然后,要访问该值,您可以使用循环:

def change(json, path, newVal):
    cur = json
    for key in path[:-1]:
        cur = cur[key]
    cur[path[-1]] = newVal

path = notification['paths'][0]
#path, for example, could be ['children', 2, 'children', 'children', 0, 'value']
newVal = 'what ever you want'
change(notification, path, newVal)