Make-distribution.sh无法生成Spark 2.4.3

时间:2019-05-21 13:48:31

标签: maven apache-spark build runnable-jar

我已经从github克隆了spark项目,并将scoverage插件添加到了父pom.xml中,并设置了zincZerver为false,并在pom.xml中添加了一个报告标签,以下是我对pom所做的更改.xml。

<useZincServer>false</useZincServer>

在属性标签中

 <scoverage.scalacPluginVersion>1.3.1</scoverage.scalacPluginVersion>
    <scoverage.aggregate>true</scoverage.aggregate>

构建后

  <reporting>
        <plugins>
            <plugin>
                <groupId>org.scoverage</groupId>
                <artifactId>scoverage-maven-plugin</artifactId>
                <version>1.3.0</version>
                <reportSets>
                    <reportSet>
                        <reports>
                            <report>report</report>
                        </reports>
                    </reportSet>
                </reportSets>
            </plugin>
        </plugins>
  </reporting>

进行更改后,我在make-distribution.sh的构建命令中进行了更改,即:

BUILD_COMMAND=("$MVN" -T 1C -DskipTests clean scoverage:package $@)

现在在运行命令make-distribution.sh --pip --r --tzg以及带有--mvn -DskipTests clean package的所有其他标签时,它将为我提供此输出。

+ DISTDIR=/home/linuxuser/spark-new/spark/dist
+ MAKE_TGZ=false
+ MAKE_PIP=false
+ MAKE_R=false
+ NAME=none
+ MVN=/home/linuxuser/spark-new/spark/build/mvn
+ ((  17  ))
+ case $1 in
+ NAME=custom-scoverage-spark
+ shift
+ shift
+ ((  15  ))
+ case $1 in
+ MAKE_PIP=true
+ shift
+ ((  14  ))
+ case $1 in
+ MAKE_R=true
+ shift
+ ((  13  ))
+ case $1 in
+ MAKE_TGZ=true
+ shift
+ ((  12  ))
+ case $1 in
+ break
+ '[' -z /opt/java ']'
+ '[' -z /opt/java ']'
++ command -v git
+ '[' /usr/bin/git ']'
++ git rev-parse --short HEAD
+ GITREV=5f4b50513c
+ '[' '!' -z 5f4b50513c ']'
+ GITREVSTRING=' (git revision 5f4b50513c)'
+ unset GITREV
++ command -v /home/linuxuser/spark-new/spark/build/mvn
+

 '[' '!' /home/linuxuser/spark-new/spark/build/mvn ']'
++ /home/linuxuser/spark-new/spark/build/mvn help:evaluate -Dexpression=project.version -Psparkr -Phadoop-2.7 -Phive -Phive-thriftserver -Pmesos -Pyarn -Pkubernetes --mvn -DskipTests clean package -Dscala.version=2.12.6
++ grep -v INFO
++ grep -v WARNING
++ tail -n 1
+ VERSION=' -X,--debug                             Produce execution debug output
'

有人可以告诉我这是怎么回事吗?

谢谢

1 个答案:

答案 0 :(得分:0)

我只执行了./make-distribution.sh而没有附加标签来解决了这个问题。