Question

我需要将非结构化ASCII数据读入numpy数组。例如，文件可能如下所示：

August 2005  OMI/MLS Tropo O3 Column (Dobson Units) X 10
Longitudes:  288 bins centered on 179.375W to 179.375E (1.25 degree steps)
Latitudes:  120 bins centered on -59.5S to 59.5N (1.00 degree steps)
 328322313320278255239243234240225243250276274188185228257307324334334266313
 302258249235303178184163133153233228193216245221235281235224200210217230239
 191168179199198202222218245272269260258253218217210250231221213216240220230
 216279262220205244255248266272235220215247221247253256261267284338317329327
 275288270253286272233215227999999999999999999999999999999999999999999999239
 242999999999999999999999999999999999999999999999999999999999999999999999999
 999999999999999999999999999636424663381417483472317200246338302140324258325
 317230243347274290259261255330322375318317342306373366375352345250278335368
 375393564999999999999999999999999999438341418448231272245265308299313365342
 345314325296273307328359375259284351376369317330358317321366329340334339373
 407376272226292357341348382369355358374361347367379368403379381398398391323
 347378367379364312306309280258236214206  lat =  -59.5
 316310310293280262250206199190174179239247204207187196190270280309302278294
 308261231270273168191184156219199179222218215193232261268223237236261272214
 236220178158177207189221200198234246226229180204217215226241245235215222225
 209205234227275264281264261234208289284263250249258265225251284273276301269
 239243250255236228260229255329236284274231245262999999999999999999999999999
 999999999999999459638999999999999999999999999999999999999999999999999999999
 366999999999999999999582427465386389430321336350319362400413409449373362351
 271274248359373294236244235229267275324307397319313380360399346279304265237
 247239249134219323393348313334215295273333329373309298298304349363369356338
 319343300279282287322317319324342311372379331353318288305319319373341352331
 354353342325316319356388409388344360388383361374397365361341379362384403407
 350343334328301279293228252243246231241  lat =  -58.5

跳过前三行后，每行12行包含总2D阵列的一行。它的连接int各有三位数。

有没有办法在numpy中这样做（有点）？ loadtxt需要一个delimiter关键字，但我这里没有分隔符，所以我迷路了。

当然可以手动手动执行此操作，即手动读取文件，计算行数，拆分字符串以及单独转换它们。但那非常麻烦。所以我正在寻找更优雅的东西。

编辑： lat = XXXXX可以忽略。我可以轻松地从标题信息中重建纬度。

Answer 1

有点黑客攻击，但它没有读到“手动”。

nrows = 2
ncols = 25

nlines = 12
lastline = 13

a = np.genfromtxt('tmp.txt',
                  skip_header=3,
                  delimiter=[4]+[3,]*(ncols-1),
                  comments='l',
                  dtype=int)
a = a.reshape(nrows,-1)[:,:ncols*(nlines-1)+lastline]

您可以delimiter = [length of widths]使用[4, 3, 3, 3, ...]，因为每行的第一个值都有一个空格，宽度为4。

您可以忽略lat = ... comments = 'l'

最大的问题是你必须重塑然后切断（因为最后一个文件行较短，数组不是'矩形'所以它填充-1 s。这需要你知道一些关于文件的形状/大小。

如何在numpy中读取非结构化的ASCII数据？

1 个答案: