Question

在我的HDFS群集上工作时，我收到此错误

SELECT * 
FROM testtel
WHERE PATINDEX('%[0-9]%',tel) > 0

每当我跑

tel
-----------------------------
ID# 12
ID23
45(ID)

(3 rows affected)

快速检查互联网，我看到它是Hadoop 2.7.0中的错误。

Answer 1

要解决此问题，我必须删除一些Hadoop快照文件。我相信一个/一些快照已经损坏，因为几天前我的一个数据节点已从我的集群中不当地退役了。

hdfs lsSnapshottableDir
drwxr-xr-x 0 hdfs supergroup 0 2018-01-30 17:04 0 65536 /data

[hdfs@hmastera ~]$ hdfs dfs -ls /data/.snapshot
Found 5 items
drwxr-xr-x   - hdfs supergroup          0 2017-08-19 01:06 /data/.snapshot/insight-dl-cluster_snapshot_20170819T010503
drwxr-xr-x   - hdfs supergroup          0 2017-08-19 01:08 /data/.snapshot/insight-dl-cluster_snapshot_20170819T010746
drwxr-xr-x   - hdfs supergroup          0 2017-08-19 01:12 /data/.snapshot/insight-dl-cluster_snapshot_20170819T011013
drwxr-xr-x   - hdfs supergroup          0 2017-08-19 01:14 /data/.snapshot/insight-dl-cluster_snapshot_20170819T011219
drwxr-xr-x   - hdfs supergroup          0 2018-01-13 16:24 /data/.snapshot/insight-dl-cluster_snapshot_20180113T162234

`

然后我开始删除快照，直到我恢复了mojo。

   hdfs@ hmastera ~]
        hdfs dfs -deleteSnapshot /data  insight-dl-cluster_snapshot_20170819T010503
        hdfs dfs -deleteSnapshot /data  insight-dl-cluster_snapshot_20170819T010746
        hdfs dfs -deleteSnapshot /data  insight-dl-cluster_snapshot_20170819T011013
        hdfs dfs -deleteSnapshot /data  insight-dl-cluster_snapshot_20170819T011219
        hdfs dfs -deleteSnapshot /data insight-dl-cluster_snapshot_20180113T162234

[hdfs@ hmastera ~]$ hdfs dfs -du -h -s /data
        510.1 G  /data

Hadoop错误du：java.util.ConcurrentModificationException

1 个答案: