在没有任何RUNNING驱动程序的WAITING状态下激活多个应用程序

时间:2017-09-04 17:39:59

标签: apache-spark

虽然这些应用程序没有活动的驱动程序,但WAITING状态下有很多应用程序。

<!DOCTYPE html><html>
      <head>
        <meta http-equiv="Content-type" content="text/html; charset=utf-8"/><link rel="stylesheet" href="/static/bootstrap.min.css" type="text/css"/><link rel="stylesheet" href="/static/vis.min.css" type="text/css"/><link rel="stylesheet" href="/static/webui.css" type="text/css"/><link rel="stylesheet" href="/static/timeline-view.css" type="text/css"/><script src="/static/sorttable.js"></script><script src="/static/jquery-1.11.1.min.js"></script><script src="/static/vis.min.js"></script><script src="/static/bootstrap-tooltip.js"></script><script src="/static/initialize-tooltips.js"></script><script src="/static/table.js"></script><script src="/static/additional-metrics.js"></script><script src="/static/timeline-view.js"></script><script src="/static/log-view.js"></script><script src="/static/webui.js"></script><script>setUIRoot('')</script>

        <title>Spark Master at spark://test-5-sparkMaster:7077</title>
      </head>
      <body>
        <div class="container-fluid">
          <div class="row-fluid">
            <div class="span12">
              <h3 style="vertical-align: middle; display: inline-block;">
                <a style="text-decoration: none" href="/">
                  <img src="/static/spark-logo-77x50px-hd.png"/>
                  <span class="version" style="margin-right: 15px;">2.1.0</span>
                </a>
                Spark Master at spark://test-5-sparkMaster:7077
              </h3>
            </div>
          </div>
          <div class="row-fluid">
          <div class="span12">
            <ul class="unstyled">
              <li><strong>URL:</strong> spark://test-5-sparkMaster:7077</li>
              <li>
                    <strong>REST URL:</strong> spark://test-5-sparkMaster:6066
                    <span class="rest-uri"> (cluster mode)</span>
                  </li>
              <li><strong>Alive Workers:</strong> 1</li>
              <li><strong>Cores in use:</strong> 4 Total,
                4 Used</li>
              <li><strong>Memory in use:</strong>
                20.0 GB Total,
                18.0 GB Used</li>
              <li><strong>Applications:</strong>
                29 <a href="#running-app">Running</a>,
                21 <a href="#completed-app">Completed</a> </li>
              <li><strong>Drivers:</strong>
                2 Running,
                0 Completed </li>
              <li><strong>Status:</strong> ALIVE</li>
            </ul>
          </div>
        </div><div class="row-fluid">
          <div class="span12">
            <h4> Workers </h4>
            <table class="table table-bordered table-condensed table-striped sortable">
      <thead><th width="" class="">Worker Id</th><th width="" class="">Address</th><th width="" class="">State</th><th width="" class="">Cores</th><th width="" class="">Memory</th></thead>
      <tbody>
        <tr>
      <td>
          <a href="http://10.247.247.144:8081">worker-20170903103903-10.247.247.144-57170</a>
      </td>
      <td>10.247.247.144:57170</td>
      <td>ALIVE</td>
      <td>4 (4 Used)</td>
      <td sorttable_customkey="20480.18432">
        20.0 GB
        (18.0 GB Used)
      </td>
    </tr>
      </tbody>
    </table>
          </div>
        </div><div class="row-fluid">
          <div class="span12">
            <h4 id="running-app"> Running Applications </h4>
            <table class="table table-bordered table-condensed table-striped sortable">
      <thead><th width="" class="">Application ID</th><th width="" class="">Name</th><th width="" class="">Cores</th><th width="" class="">Memory per Node</th><th width="" class="">Submitted Time</th><th width="" class="">User</th><th width="" class="">State</th><th width="" class="">Duration</th></thead>
      <tbody>
        <tr>
      <td>
        <a href="app?appId=app-20170903103909-0049">app-20170903103909-0049</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 10:39:09</td>
      <td>root</td>
      <td>WAITING</td>
      <td>22 min</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903103408-0047">app-20170903103408-0047</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 10:34:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>27 min</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903103408-0046">app-20170903103408-0046</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 10:34:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>27 min</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903102808-0045">app-20170903102808-0045</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 10:28:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>33 min</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903102808-0044">app-20170903102808-0044</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 10:28:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>33 min</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903020108-0043">app-20170903020108-0043</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 02:01:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.0 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903020108-0042">app-20170903020108-0042</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 02:01:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.0 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015855-0041">app-20170903015855-0041</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:58:55</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.0 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015855-0040">app-20170903015855-0040</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:58:55</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.0 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015608-0039">app-20170903015608-0039</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:56:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015608-0038">app-20170903015608-0038</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:56:08</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015413-0037">app-20170903015413-0037</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:54:13</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015413-0036">app-20170903015413-0036</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:54:13</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015153-0035">app-20170903015153-0035</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:51:53</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015153-0034">app-20170903015153-0034</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:51:53</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.1 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015046-0033">app-20170903015046-0033</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:50:46</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903015043-0032">app-20170903015043-0032</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:50:43</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014859-0031">app-20170903014859-0031</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:48:59</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014858-0030">app-20170903014858-0030</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:48:58</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014713-0029">app-20170903014713-0029</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:47:13</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014713-0028">app-20170903014713-0028</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:47:13</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.2 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014453-0027">app-20170903014453-0027</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:44:53</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014453-0026">app-20170903014453-0026</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:44:53</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014309-0025">app-20170903014309-0025</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:43:09</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014309-0024">app-20170903014309-0024</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:43:09</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014158-0023">app-20170903014158-0023</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:41:58</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014158-0022">app-20170903014158-0022</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:41:58</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014048-0021">app-20170903014048-0021</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        0
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:40:48</td>
      <td>root</td>
      <td>WAITING</td>
      <td>9.3 h</td>
    </tr><tr>
      <td>
        <a href="app?appId=app-20170903014048-0020">app-20170903014048-0020</a>

      </td>
      <td>
        <a href="">test-L-Correlation</a>
      </td>
      <td>
        2
      </td>
      <td sorttable_customkey="16384">
        16.0 GB
      </td>
      <td>2017/09/03 01:40:48</td>
      <td>root</td>
      <td>RUNNING</td>
      <td>9.3 h</td>
    </tr>
      </tbody>
    </table>
          </div>
        </div><div>
          <div class="row-fluid">
               <div class="span12">
                 <h4> Running Drivers </h4>
                 <table class="table table-bordered table-condensed table-striped sortable">
      <thead><th width="" class="">Submission ID</th><th width="" class="">Submitted Time</th><th width="" class="">Worker</th><th width="" class="">State</th><th width="" class="">Cores</th><th width="" class="">Memory</th><th width="" class="">Main Class</th></thead>
      <tbody>
        <tr>
      <td>driver-20170903010850-0001 </td>
      <td>Sun Sep 03 01:08:50 IST 2017</td>
      <td><a href="http://10.247.247.144:8081">
          worker-20170903103903-10.247.247.144-57170</a>
      </td>
      <td>RUNNING</td>
      <td sorttable_customkey="1">
        1
      </td>
      <td sorttable_customkey="1024">
        1024.0 MB
      </td>
      <td>TestRunner</td>
    </tr><tr>
      <td>driver-20170903010850-0000 </td>
      <td>Sun Sep 03 01:08:50 IST 2017</td>
      <td><a href="http://10.247.247.144:8081">
          worker-20170903103903-10.247.247.144-57170</a>
      </td>
      <td>RUNNING</td>
      <td sorttable_customkey="1">
        1
      </td>
      <td sorttable_customkey="1024">
        1024.0 MB
      </td>
      <td>TestRunner</td>
    </tr>
      </tbody>
    </table>
               </div>
             </div>
        </div><div class="row-fluid">
          <div class="span12">
            <h4 id="completed-app"> Completed Applications </h4>
            <table class="table table-bordered table-condensed table-striped sortable">
      <thead><th width="" class="">Application ID</th><th width="" class="">Name</th><th width="" class="">Cores</th><th width="" class="">Memory per Node</th><th width="" class="">Submitted Time</th><th width="" class="">User</th><th width="" class="">State</th><th width="" class="">Duration</th></thead>
      <tbody>
        <tr>
      <td>
        <a href="app?appId=app-20170903013808-0019">app-20170903013808-0019</a>

      </td>
    </tr>
      </tbody>
    </table>
          </div>
        </div><div>
          <div class="row-fluid">
                <div class="span12">
                  <h4> Completed Drivers </h4>
                  <table class="table table-bordered table-condensed table-striped sortable">
      <thead><th width="" class="">Submission ID</th><th width="" class="">Submitted Time</th><th width="" class="">Worker</th><th width="" class="">State</th><th width="" class="">Cores</th><th width="" class="">Memory</th><th width="" class="">Main Class</th></thead>
      <tbody>

      </tbody>
    </table>
                </div>
              </div>
        </div>
        </div>
      </body>
    </html>

不确定为什么系统会进入此状态,但在此期间,所有工作人员都进行了多次重启。

我尝试在docker环境中重新创建问题,但每次重新启动一个worker时,驱动程序将进入“RELAUNCHING”状态,关联的应用程序将以“FINISHED”状态结束

有人对此有任何想法吗?

提前致谢。

//

0 个答案:

没有答案