我正在使用10核r4.8xlarge集群。 AWS文档https://aws.amazon.com/ec2/virtualcores/说,每个r4.8xlarge的EC2实例类型都包含一个16的虚拟核心数。问题1.这是否意味着并行有160个核心(每个执行者16个核心。我还问,是核心=火花执行者)? Q2。 Spark文档说
The number of cores allocated to the Spark Streaming application must be more than the number of receivers. Otherwise the system will receive data, but not be able to process it.
Q2。如果要为我的火花流作业创建15个接收器,则应将spark.executor.cores设置为15或更高。还是应该将群集的核心总数从10个增加到15个?