Question

您好我正在尝试对spark作业服务器进行压力测试，并且我在提交的作业中与以下属性共享spark上下文。

spark.executor.cores ='2'

spark.cores.max ='1'

spark.driver.cores = '1'

spark.driver.memory ='1g'

spark.executor.memory = '1克'

spark.executor.instances ='2'

spark.scheduler.mode = '公平'

spark.scheduler.pool = 'fair_pool'

spark.scheduler.allocation.file ='/火花jobserver / scheduler.xml

当我使用Jmeter在100毫秒内发布10个作业时，只有4到5个作业成功响应，而其他作业则出现以下错误：

{
  "status": "ERROR",
  "result": {
    "message": "Ask timed out on [Actor[akka://JobServer/user/context-supervisor/admin-context#-1409264293]] after [10000 ms]. Sender[null] sent message of type \"spark.jobserver.JobManagerActor$StartJob\".",
    "errorClass": "akka.pattern.AskTimeoutException",
    "stack": ["akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:604)", "akka.actor.Scheduler$$anon$4.run(Scheduler.scala:126)", "scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)", "scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)", "scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)", "akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:331)", "akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:282)", "akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:286)", "akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:238)", "java.lang.Thread.run(Thread.java:748)"]
  }
}

请注意，我期待响应时间的异步成功响应。

Spark Jobserver - 压力测试 - 异步POST错误响应：akka.pattern.AskTimeoutException

0 个答案: