Spark为什么一个工人会自动启动我的主人

时间:2016-02-01 00:47:41

标签: apache-spark

我有3台机器,一台是主机,另外两台是奴隶。我有spark / conf / masters中的主地址和spark / conf / slaves中的两个slave。

我运行Error:(31, 40) inferred type arguments [Nothing,name.abhijitsarkar.scala.MyList[Int]] do not conform to class MyListMatcher's type parameter bounds [Int,A <: name.abhijitsarkar.scala.MyList[Int]] def equal[Int](right: MyList[Int]) = new MyListMatcher(right) ^ Error:(31, 58) type mismatch; found : name.abhijitsarkar.scala.MyList[Int] required: A def equal[Int](right: MyList[Int]) = new MyListMatcher(right) ^ Error:(27, 9) overloaded method value should with alternatives: (endWithWord: org.scalatest.words.EndWithWord)(implicit ev: <:<[name.abhijitsarkar.scala.MyList[scala.Int],String])MyListSpec.this.ResultOfEndWithWordForString <and> (startWithWord: org.scalatest.words.StartWithWord)(implicit ev: <:<[name.abhijitsarkar.scala.MyList[scala.Int],String])MyListSpec.this.ResultOfStartWithWordForString <and> (includeWord: org.scalatest.words.IncludeWord)(implicit ev: <:<[name.abhijitsarkar.scala.MyList[scala.Int],String])MyListSpec.this.ResultOfIncludeWordForString <and> (notExist: org.scalatest.words.ResultOfNotExist)(implicit existence: org.scalatest.enablers.Existence[name.abhijitsarkar.scala.MyList[scala.Int]])Unit <and> (existWord: org.scalatest.words.ExistWord)(implicit existence: org.scalatest.enablers.Existence[name.abhijitsarkar.scala.MyList[scala.Int]])Unit <and> (containWord: org.scalatest.words.ContainWord)org.scalatest.words.ResultOfContainWord[name.abhijitsarkar.scala.MyList[scala.Int]] <and> (haveWord: org.scalatest.words.HaveWord)MyListSpec.this.ResultOfHaveWordForExtent[name.abhijitsarkar.scala.MyList[scala.Int]] <and> (beWord: org.scalatest.words.BeWord)MyListSpec.this.ResultOfBeWordForAny[name.abhijitsarkar.scala.MyList[scala.Int]] <and> (inv: org.scalactic.TripleEqualsSupport.TripleEqualsInvocationOnSpread[name.abhijitsarkar.scala.MyList[scala.Int]])(implicit ev: Numeric[name.abhijitsarkar.scala.MyList[scala.Int]])Unit <and> [U](inv: org.scalactic.TripleEqualsSupport.TripleEqualsInvocation[U])(implicit constraint: org.scalactic.Constraint[name.abhijitsarkar.scala.MyList[scala.Int],U])Unit <and> (notWord: org.scalatest.words.NotWord)org.scalatest.words.ResultOfNotWordForAny[name.abhijitsarkar.scala.MyList[scala.Int]] <and> [TYPECLASS1[_], TYPECLASS2[_]](rightMatcherFactory2: org.scalatest.matchers.MatcherFactory2[name.abhijitsarkar.scala.MyList[scala.Int],TYPECLASS1,TYPECLASS2])(implicit typeClass1: TYPECLASS1[name.abhijitsarkar.scala.MyList[scala.Int]], implicit typeClass2: TYPECLASS2[name.abhijitsarkar.scala.MyList[scala.Int]])Unit <and> [TYPECLASS1[_]](rightMatcherFactory1: org.scalatest.matchers.MatcherFactory1[name.abhijitsarkar.scala.MyList[scala.Int],TYPECLASS1])(implicit typeClass1: TYPECLASS1[name.abhijitsarkar.scala.MyList[scala.Int]])Unit <and> (rightMatcherX1: org.scalatest.matchers.Matcher[name.abhijitsarkar.scala.MyList[scala.Int]])Unit cannot be applied to (name.abhijitsarkar.scala.MyListMatcher[Int(in class MyListMatcher),A]) o should equal(op) ^ Error:(46, 21) name.abhijitsarkar.scala.Cons[Int] does not take parameters case Cons[Int](h, t) if right.isInstanceOf[Cons[Int]] => { ^ 我有没有工人的GUI - 一切都很好 然后我运行start-masters.sh并在GUI中获取我的两个奴隶 - 一切都很好

但是,当我开始一个作业,指定主网址为start-slaves.sh时,它与主文件中的地址相同,并且从主GUI中获取,工作人员将在所有计算机上启动。

为什么呢?我不希望主服务器上的工作人员因为驱动程序使用太多内存而无法与工作程序/执行程序共享计算机。我究竟做错了什么?我必须在主人身上经营一名工人吗?我应该将主服务器移动到其中一个从服务器并使用当前主服务器作为Spark的客户端吗?

0 个答案:

没有答案