我们在Apache NiFi中配置PutHDFS处理器中的凭证

时间:2017-03-03 10:59:25

标签: hortonworks-data-platform apache-nifi

我在PutHDFS中配置了一个路径,它抛出了身份验证错误

LOG:

2017-03-03 01:52:29,200 DEBUG [IPC客户端(1496249304)从root连接到dnn01.com/10.4.151.88:8020] org.apache.hadoop.ipc.Client IPC Client(1496249304)连接到dnn01.com/10.4.151.88:8020从root得到的值#39976 2017-03-03 01:52:29,201 TRACE [计时器驱动的进程线程-7] org.apache.hadoop.ipc.ProtobufRpcEngine 105:异常&lt ;- dnn01.com/10.4.151.88:8020:create {org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):权限被拒绝:user = root,access = WRITE,inode =“/ raw / externaltbls / falcon / testing / .1PUGETSLA_PO810.P0125.EDIINV.P20150125.107.20160304025143629.gz“:hdfs:hdfs:drwxrwxr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)在org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)

2017-03-03 01:52:29,201 ERROR [计时器驱动的进程线程-7] o.apache.nifi.processors.hadoop.PutHDFS PutHDFS [id = 015a1010-9c64-1ed3-c39b-d19ab2dfe19b]无法由于org.apache.nifi.processor.exception.ProcessException而写入HDFS:从PutHDFS抛出IOException [id = 015a1010-9c64-1ed3-c39b-d19ab2dfe19b]:org.apache.hadoop.security.AccessControlException:Permission denied:user = root,access = WRITE,inode =“/ raw / externaltbls / falcon / testing / .1PUGETSLA_PO810.P0125.EDIINV.P20150125.107.20160304025143629.gz”:hdfs:hdfs:drwxrwxr-x at org.apache.hadoop.hdfs.server。 namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)

1 个答案:

答案 0 :(得分:2)

PutHDFS处理器将作为NiFi运行的操作系统用户执行。在您的情况下,您似乎以root身份运行NiFi,因为日志显示“Permission denied:user = root,access = WRITE”。

您的选择是:

  1. 授予您写入目录的根WRITE访问权限(/ raw / externaltbls / falcon / testing /)
  2. 以具有WRITE访问权限的其他用户身份运行NiFi
  3. 使用Kerberos并指定PutHDFS处理器中的主体和密钥表