Question

为了使用TableMapper，我将hbase-server依赖项包含在我的hadoop项目中。 hbase-shaded-client和hbase-server都有1.1.2版本。

但是当我尝试运行hadoop作业时，我遇到了一个似乎与安全相关的错误：

 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoSuchMethodError: org.apache.hadoop.security.authentication.server.AuthenticationFilter.constructSecretProvider(Ljavax/servlet/ServletContext;Ljava/util/Properties;Z)Lorg/apache/hadoop/security/authentication/util/SignerSecretProvider;
    at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:447)
    at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:339)
    at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:114)
    at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:290)
    at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:261)
    at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:303)
    at org.apache.hadoop.mapreduce.v2.app.client.MRClientService.serviceStart(MRClientService.java:142)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1107)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1519)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
2016-08-22 11:04:29,010 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1

之前有人有这个问题吗？

谢谢。

Answer 1

hbase着色客户端似乎引入了一个无阴影版本的servlet api类。在部署到Web服务器或任何其他需要不同版本的servlet api的框架时，这可能会导致问题。

使用hbase-server

1 个答案: