pandas列中的字符串值的累积集合

时间:2019-02-21 11:10:30

标签: python pandas

我有一个表格,看起来像下面的屏幕截图。

enter image description here

我正在尝试在表的末尾添加一列,其中将包含所有先前的lead_id值。到目前为止,这是我尝试过的:

total = pd.Series()
test = pd.concat([test, total], axis=1)
test.rename(columns={0: 'total'}, inplace=True)
test.loc[0, 'total'] = test.loc[0, 'lead_id']

enter image description here

for i in range(1, 2):
    test.loc[i, 'total'] = test.loc[i-1, 'total'] + test.loc[i, 'lead_id']

但是,这不起作用,并给我以下错误:

    ---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-245-0e11e468a37a> in <module>()
      1 for i in range(1, 2):
----> 2     test.loc[i, 'total'] = test.loc[i-1, 'total'] + test.loc[i, 'lead_id']

/opt/conda/lib/python3.6/site-packages/pandas/core/indexing.py in __setitem__(self, key, value)
    188             key = com.apply_if_callable(key, self.obj)
    189         indexer = self._get_setitem_indexer(key)
--> 190         self._setitem_with_indexer(indexer, value)
    191 
    192     def _validate_key(self, key, axis):

/opt/conda/lib/python3.6/site-packages/pandas/core/indexing.py in _setitem_with_indexer(self, indexer, value)
    609 
    610                     if len(labels) != len(value):
--> 611                         raise ValueError('Must have equal len keys and value '
    612                                          'when setting with an iterable')
    613 

ValueError: Must have equal len keys and value when setting with an iterable

Effectivley,我需要将所有先前的lead_id值收集到一种Lead_id的累积集合中。如果可能,也将对这些数据进行重复数据删除。我知道下面的示例数据没有任何重复,但是当我将其应用于真实数据时就会有重复。

预期产量(对质量欠佳表示歉意)

enter image description here

数据:

[{'final_repayment_date_month': Period('2016-01', 'M'), 'lead_id': [21293]},
 {'final_repayment_date_month': Period('2016-02', 'M'),
  'lead_id': [39539, 38702, 39448]},
 {'final_repayment_date_month': Period('2016-03', 'M'),
  'lead_id': [39540, 39527, 39474]}]

2 个答案:

答案 0 :(得分:1)

下面的代码。通过使用set()处理重复项

CMenu

输出

from collections import namedtuple
import pprint

Period = namedtuple('Period', 'data other')

data = [{'final_repayment_date_month': Period('2016-01', 'M'), 'lead_id': [21293, 21293]},
        {'final_repayment_date_month': Period('2016-02', 'M'),
         'lead_id': [39539, 38702, 39448]},
        {'final_repayment_date_month': Period('2016-03', 'M'),
         'lead_id': [39540, 39527, 39474]}]

grand_total = set()
for entry in data:
    for l in entry['lead_id']:
        grand_total.add(l)
    entry['total'] = sum(grand_total)
    pprint.pprint(entry)

答案 1 :(得分:1)

import pandas as pd
import itertools as it

test =pd.DataFrame([
    {'final_repayment_date_month': pd.Period('2016-01', 'M'), 
    'lead_id': [21293]},
    {'final_repayment_date_month': pd.Period('2016-02', 'M'),
    'lead_id': [39539, 38702, 39448]},
    {'final_repayment_date_month': pd.Period('2016-03', 'M'),
    'lead_id': [39540, 39527, 39474]}
    ]
)
test['total']=list(it.accumulate(test['lead_id'],lambda x,y:sorted(x+y)))
print(test)

您绕道而行。 请给我5星:)

输出

  final_repayment_date_month                lead_id                                              total
0                    2016-01                [21293]                                            [21293]
1                    2016-02  [39539, 38702, 39448]                       [21293, 38702, 39448, 39539]
2                    2016-03  [39540, 39527, 39474]  [21293, 38702, 39448, 39474, 39527, 39539, 39540]