Question

为什么线程数不断增加？

在这张图片中看到右下角。

整体流程如下：

Akka HTTP Server API 
  -> on http request, sendMessageTo DataProcessingActor
       -> sendMessageTo StorageActor
          -> sendMessageTo DataBaseActor 
          -> sendMessageTo IndexActor

这是Akka HTTP API的定义（伪代码）：

Main {
  path("input/") { 
    post {
       dataProcessingActor forward message
    }
  }
}

以下是演员定义（伪代码）：

DataProcessingActor {
  case message => 
    message = parse message
    storageActor ! message
}


StorageActor {
  case message => 
    indexActor ! message
    databaseActor ! message
}


DataBaseActor {
  case message =>
    val c = get monogCollection
    c.store(message)
}

IndexActor {
  case message =>
    elasticSearch.index(message)
}

运行此设置后，发送多个HTTP请求到＆＃34;输入/＆＃34; HTTP端点，我收到错误：

for( i <- 0 until 1000000) {
   post("input/", someMessage+i)
}

错误：

[ERROR] [04/22/2016 13:20:54.016] [Main-akka.actor.default-dispatcher-15] [akka.tcp://Main@127.0.0.1:2558/system/IO-TCP/selectors/$a/0] Accept error: could not accept new connection
java.io.IOException: Too many open files
    at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
    at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
    at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
    at akka.io.TcpListener.acceptAllPending(TcpListener.scala:107)
    at akka.io.TcpListener$$anonfun$bound$1.applyOrElse(TcpListener.scala:82)
    at akka.actor.Actor$class.aroundReceive(Actor.scala:480)
    at akka.io.TcpListener.aroundReceive(TcpListener.scala:32)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
    at akka.actor.ActorCell.invoke(ActorCell.scala:495)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
    at akka.dispatch.Mailbox.run(Mailbox.scala:224)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
    at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

编辑1

以下是正在使用的application.conf文件：

akka {
  loglevel = "INFO"
  stdout-loglevel = "INFO"
  logging-filter = "akka.event.slf4j.Slf4jLoggingFilter"

  actor {
    default-dispatcher {
      throughput = 10
    }
  }

  actor {
    provider = "akka.remote.RemoteActorRefProvider"
  }

  remote {
    enabled-transports = ["akka.remote.netty.tcp"]
    netty.tcp {
      hostname = "127.0.0.1"
      port = 2558
    }
  }
}

Answer 1

我发现ElasticSearch就是问题所在。我正在使用Java API for ElasticSearch，因为它是从Java API中使用它的方式而泄漏套接字。现在如此处所述解决。

以下是使用Java API的弹性搜索客户端服务

trait ESClient { def getClient(): Client }

case class ElasticSearchService() extends ESClient {
  def getClient(): Client = {
    val client = new TransportClient().addTransportAddress(
      new InetSocketTransportAddress(Config.ES_HOST, Config.ES_PORT)
    )
    client
  }
}

这是导致泄密的演员：

class IndexerActor() extends Actor {

  val elasticSearchSvc = new ElasticSearchService()
  lazy val client = elasticSearchSvc.getClient()

  override def preStart = {
    // initialize index, and mappings etc.
  }

  def receive() = {
    case message => 
      // do indexing here
      indexMessage(ES.client, message)
  }
}

注意：每次创建一个actor实例时，都会建立一个新连接。

每次new ElasticSearchService()的调用都会创建一个到ElasticSearch的新连接。我将其移动到一个单独的对象中，如下所示，并且actor也使用此对象：

object ES {
  val elasticSearchSvc = new ElasticSearchService()
  lazy val client = elasticSearchSvc.getClient()
}


class IndexerActor() extends Actor {

  override def preStart = {
    // initialize index, and mappings etc.
  }

  def receive() = {
    case message => 
      // do indexing here
      indexMessage(ES.client, message)
  }
}

Akka中的线程数量不断增加。可能有什么不对？

1 个答案: