Oneliner从多列创建字符串列

时间:2017-10-01 17:27:20

标签: python pandas

考虑以下代码

import pandas as pd
df = pd.DataFrame({'col_1' : [1, 2, 3, 4],\
                   'col_2' : ['a', 'b', 'c', 'd'],\
                   'col_3' : ['hey', 'ho', 'banana', 'go']})

col = df['col_1'].astype(str) + '_' + \
      df['col_2'].astype(str) + '_' + \
      df['col_3'].astype(str)

col
Out[12]: 
0       1_a_hey
1        2_b_ho
2    3_c_banana
3        4_d_go
dtype: object

有人能想到使用数组col作为输入生成col_names = ['col_1', 'col_2', 'col_3']的oneliner吗?

col_sum = something_smart(col_names)

显然,例如,different_col_set = ['col_2', 'col_3']

something_smart(different_col_set)
Out[13]: 
0         a_hey
1          b_ho
2      c_banana
3          d_go
dtype: object

关键在于col_names是一个包含数据帧列名的子集的数组。

1 个答案:

答案 0 :(得分:2)

选项1] 使用apply你可以'_'.join

In [5521]: df[col_names].astype(str).apply('_'.join, axis=1)
Out[5521]:
0       1_a_hey
1        2_b_ho
2    3_c_banana
3        4_d_go
dtype: object

In [5523]: df[different_col_set].astype(str).apply('_'.join, axis=1)
Out[5523]:
0       a_hey
1        b_ho
2    c_banana
3        d_go
dtype: object

选项2] 在这种情况下,使用reduce比应用更快。

In [5527]: reduce(lambda x, y: x + '_' + y, [df[c].astype(str) for c in col_names])
Out[5527]:
0       1_a_hey
1        2_b_ho
2    3_c_banana
3        4_d_go
dtype: object

In [5528]: reduce(lambda x, y: x + '_' + y, [df[c].astype(str) for c in different_col_set])
Out[5528]:
0       a_hey
1        b_ho
2    c_banana
3        d_go
dtype: object

reduce(lambda x, y: x.astype(str) + '_' +y.astype(str), [df[x] for x in col_names])

类似

计时

In [5556]: df.shape
Out[5556]: (10000, 3)

In [5553]: %timeit reduce(lambda x, y: x + '_' + y, [df[c].astype(str) for c in col_names])
10 loops, best of 3: 21.7 ms per loop

In [5554]: %timeit reduce(lambda x, y: x.astype(str) + '_' +y.astype(str), [df[x] for x in col_names])
10 loops, best of 3: 22.3 ms per loop

In [5555]: %timeit df[col_names].astype(str).apply('_'.join, axis=1)
1 loop, best of 3: 254 ms per loop