Flink 1.6.0 Job jar上传大小限制

时间:2018-08-17 10:45:27

标签: apache-flink

作业jar文件的大小限制是多少,我有机会覆盖它吗?

在退出Flink 1.6.0并使用完全REST job submission的情况下,我尝试上传jar,例如:

$ curl http://localhost:8081/jars/upload -X POST -F "jarfile=@word-count-beam/target/word-count-beam-bundled-0.1.jar" --verbose
Note: Unnecessary use of -X or --request, POST is already inferred.
*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8081 (#0)
> POST /jars/upload HTTP/1.1
> Host: localhost:8081
> User-Agent: curl/7.54.0
> Accept: */*
> Content-Length: 108716165
> Expect: 100-continue
> Content-Type: multipart/form-data; boundary=------------------------ab44aa4cd2db3c75
> 
* Done waiting for 100-continue
< HTTP/1.1 413 Request Entity Too Large
< content-length: 0
* HTTP error before end of send, stop sending
< 
* Closing connection 0

但是我得到了

413 Request Entity Too Large

jar文件的实际大小为:

$ du -h word-count-beam/target/word-count-beam-bundled-0.1.jar
113M    word-count-beam/target/word-count-beam-bundled-0.1.jar

我正在使用1.6.0-scala_2.11映像在docker中运行Flink。

更新:尝试从Web UI上传时是相同的: flink jar upload WebUI screenshot

注意:jar上传功能可与Flink 1.5(Docker)一起使用。

1 个答案:

答案 0 :(得分:4)

@robosoul,我认为有一个rest limit in config,默认情况下,最大大小为104857600(以字节为单位),看起来您超出了限制