通过索引创建有序矩阵

时间:2017-06-21 03:48:03

标签: python performance numpy indexing vectorization

我有一个与探测器相关的问题,它可以读出进入通道的光子数量以及它们进入探测器的时间,为简单起见,请说明其通道0到6。数组A将保存通道,基本上是索引列表,虽然我很好地计算光子,但我很难将时间存储在一个合理的容器中而没有循环(数据文件很大)。因此,将数组A视为索引列表,将B视为时间。

A=np.array([3,0,4,2,4,1,6])
#so this just says channel 3 got one photon, channel 0 got one, 
#channel 4 got two, 2 got one, 1 got one, channel 5 never got any so 
#it doesn't show up, and 6 got one.
B=np.array([1.2,1.6,3.,.7,.1,.05,9.])
#so here B are the times and they say (by referencing A) that channel 
#1 got a photon at .05s, channel 0 got its photon at 1.6s, channel 4 
#got a photon at 3s and another at .1s etc.
#I would like to somehow store these times in a coo sparse array or
# perhaps just a regular array that would look like:
C=np.array([[1.6,0],[.05,0],[.7,0],[1.2,0],[.1,3.0],[0,0],[.9,0]])
#the zeros could be nans of course. It would be helpful if each row 
# was ordered from earliest times to latest. This final array is
#of course ordered properly from 0 to 6 in terms of channels down
#the first axis (not in the random order that the index list was)

如果你不关心速度,这不是一个难题,但不幸的是,我最近所做的一切都需要快速。谢谢你们

1 个答案:

答案 0 :(得分:1)

这是一种矢量化方法 -

from scipy.sparse import coo_matrix

# Get sorting indices for A
n = len(A)
sidx = A.argsort()

# Use those indices to get sorted A
sA = A[sidx]

# Get shifts going from one group of identical sorted A values to another
shift_mask = np.concatenate(( [True], sA[1:] != sA[:-1] ))

# Get row indices for output array assigning
row_ids = np.zeros(n,dtype=int)
row_ids[shift_mask] = sA[shift_mask]
np.maximum.accumulate(row_ids, out=row_ids)

# Get col indices for output array assigning by using shifting mask
col_ids = intervaled_cumsum(shift_mask,trigger_val=1,start_val=0)

# Setup output sparse matrix and assign values from sorted array B
out = coo_matrix((B[sidx], (row_ids, col_ids)))

功能intervaled_cumsum  取自here

样本运行(在更通用的样本上) -

In [173]: A
Out[173]: array([3, 0, 4, 2, 4, 1, 6, 4, 2, 6])

In [174]: B
Out[174]: array([ 1.2 , 1.6 , 3.  , 0.7 , 0.1 , 0.05, 9.  , 1.5 , 2.9 , 3.1 ])

In [175]: out.toarray()
Out[175]: 
array([[ 1.6 ,  0.  ,  0.  ],
       [ 0.05,  0.  ,  0.  ],
       [ 0.7 ,  2.9 ,  0.  ],
       [ 1.2 ,  0.  ,  0.  ],
       [ 3.  ,  0.1 ,  1.5 ],
       [ 0.  ,  0.  ,  0.  ],
       [ 9.  ,  3.1 ,  0.  ]])

为了解释为排序A计算这些变化的部分,我们正在利用排序one-shifted的{​​{1}}个切片来获得表示轮班的掩码 -

A

因此,将此输出掩码与已排序的In [223]: sA # sorted A Out[223]: array([0, 1, 2, 2, 3, 4, 4, 4, 6, 6]) In [224]: sA[1:] != sA[:-1] Out[224]: array([ True, True, False, True, True, False, False, True, False], dtype=bool) In [225]: np.concatenate(( [True], sA[1:] != sA[:-1] )) Out[225]: array([ True, True, True, False, True, True, False, False, True, False], dtype=bool) 相关联,除了索引重复之外,它基本上都是A