Oozie 4.2.0使用Java 1.8构建Hadoop 2.7的错误

时间:2015-10-11 06:24:43

标签: maven hadoop oozie

我在伪hadoop模式下运行。以下组件 - Hadoop v2.7.0 - Java 1.8+ - Oozie 4.2.0 - 操作系统 - Fedora 22 VM - Maven 3.3

我对Java或Maven一无所知,而且我对使用Maven构建这个世界完全陌生。我正在探索Oozie并希望构建它,但每次我尝试构建它时,它都会失败并出现以下错误。我有搜索博客和已知博客(人们已经提到了gauravkohli博客,但这对我没有任何帮助)没有太多帮助。任何人都可以帮助我吗?

其次,虽然我已经关注了几个博客,他们已经提到只需要更改hadoop版本,但即便如此我认为我需要更改Hbase和其他组件版本,因为它们比版本中提到的更高版本。 ooze Distro,如果对此有任何意见也会有很好的见解。

[INFO]-------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] Apache Oozie Main ..............................SUCCESS [  1.995 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [  1.059 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [  0.357 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS [  0.080 s]
[INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [  8.120 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [  4.637 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [  1.528 s]
[INFO] Apache Oozie Core ..............................FAILURE [  5.388 s]
[INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
[INFO] Apache Oozie Share Lib Pig .........................SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
[INFO] Apache Oozie Examples ..............................SKIPPED
[INFO] Apache Oozie Share Lib Spark .......................SKIPPED
[INFO] Apache Oozie Share Lib .............................SKIPPED
[INFO] Apache Oozie Docs ..................................SKIPPED
[INFO] Apache Oozie WebApp ............................... SKIPPED
[INFO] Apache Oozie Tools ................................ SKIPPED
[INFO] Apache Oozie MiniOozie .............................SKIPPED
[INFO] Apache Oozie Distro ................................SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
[INFO]------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]-------------------------------------------------------------
[INFO] Total time: 51.047 s
[INFO] Finished at: 2015-10-11T12:44:19+11:00
[INFO] Final Memory: 96M/230M
[INFO]-------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-remote-resources-plugin:1.5:process (default) on project 
oozie-core: Error resolving project artifact: Could not transfer artifact 
org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to 
Codehaus repository (http://repository.codehaus.org/): 
repository.codehaus.org: unknown error for project org.pentaho:pentaho-
aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host 
repository.codehaus.org: unknown error -> [Help 1] 
[ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
[ERROR] After correcting the problems, you can resume the build with the 
command
[ERROR]   mvn <goals> -rf :oozie-core


                    **[edit]Edited: Vishant : 12-Oct-2015**

After doing some research and editing the pom.xml file. I enadbled the 
REPO1 and  Cloudera repositories, but then I stumbled upon the below 
error. I went ahead and checked the REPO1 repository
 ** DOES NOT have hbase 1.1.2 jars.**

[INFO] ----------------------------------------------------------------
[INFO] Building Apache Oozie Core 4.2.0
[INFO]-----------------------------------------------------------------
[INFO] ----------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
[INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
[INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] -------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] -------------------------------------------------------------
[INFO] Total time: 32.115 s
[INFO] Finished at: 2015-10-12T11:03:04+11:00
[INFO] Final Memory: 100M/239M
[INFO] -------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-core: Could not resolve 
dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure 
to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2 
was cached in the local repository, resolution will not be reattempted 
until the update interval of central has elapsed or updates are forced 
->[Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with 
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, 
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the 
command
[ERROR]   mvn <goals> -rf :oozie-core

我该如何处理?如何将jar添加到我的本地存储库并继续?

3 个答案:

答案 0 :(得分:0)

这是因为Codehaus.org不再托管maven repos。您可以在https://www.codehaus.org/mechanics/maven/

了解更多信息

在你的pom.xml中,将Codehaus存储库的url更改为 - &gt; https://repository-master.mulesoft.org/nexus/content/groups/public/

<repository> <id>Codehaus repository</id> <url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url> <snapshots> <enabled>false</enabled> </snapshots> </repository>

答案 1 :(得分:0)

我道歉,因为我之前没有权利回复我自己的问题!

<强>解答:
我已经解决了这个错误。按照以下步骤操作,但codehaus的内容根本不起作用 步骤1.下载jar文件 Hbase Jar

步骤2.编辑 pom.xml 以指向jar文件

    <dependency>  
        <groupID>org.apache.hbase</groupID>  
        <artifactID>hbase</artifactID>  
        <version>${hbase.version}</version>  
        <scope>system</scope>  
        <system>system/path/to/jar/file/myjar.jar</system>  
    </dependency> 

步骤3.将 Hbase 文件添加到MAVEN存储库

    mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>

编辑2016年1月13日 我添加了 hbase-common-1.1.2.jar 文件,因为我的hbase版本是1.1.2。请根据您的hbase版本添加hbase-common文件。

答案 2 :(得分:0)

我通过以下链接解决了这个pom.xml的所有问题 oozie-4.2 pom.xml

您可以看到我更改了一些配置,包括更改Codehas资源库网址 和其他一些人。

<groupId>org.apache.hadoop</groupId>
     <artifactId>hadoop-tools</artifactId>
            <version>1.2.1</version>
<!--<version>${distcp.version}</version>-->

<groupId>org.apache.hadoop</groupId>
     <artifactId>hadoop-core</artifactId>
            <version>1.2.1</version>
<!--<version>${hadoop.auth.version}</version>-->

您可以尝试使用此pom.xml进行bulid。