Spark教程

Question

我正在尝试 https://github.com/apache/spark/blob/v2.0.1/examples/src/main/scala/org/apache/spark/examples/sql/streaming/StructuredNetworkWordCountWindowed.scala 示例

但是指定端口号的输入应该是什么？

Answer 1

在终端上使用此命令。

nc -lk 9999

这将是这样的：

# TERMINAL 1:
# Running Netcat

$ nc -lk 9999
apache spark
apache hadoop

输出结果为：

-------------------------------------------
Batch: 0
-------------------------------------------
+------+-----+
| value|count|
+------+-----+
|apache|    1|
| spark|    1|
+------+-----+

-------------------------------------------
Batch: 1
-------------------------------------------
+------+-----+
| value|count|
+------+-----+
|apache|    2|
| spark|    1|
|hadoop|    1|
+------+-----+
...

并相应地查看输出。

在此更好地记录：https://home.apache.org/~pwendell/spark-nightly/spark-branch-2.0-docs/latest/structured-streaming-programming-guide.html#quick-example