无法通过curl请求使用发布请求在Flink中提交作业(请求不匹配...)

时间:2020-07-06 06:18:34

标签: apache-flink flink-streaming flink-cep

我试图将发布请求发送到在Kubernetes集群上运行的Flink Job Manager。在为不需要任何命令行参数的类发送/ jar / run的后请求时,它可以正常工作。但是,当尝试在需要命令行参数的同一jar中提交不同的类时,会出现以下错误。 -: {"errors":["Request did not match expected format JarRunRequestBody."]}'

但是,在传递命令行参数并直接提交作业时,就像下面的工作一样:

./flink run -m localhost:30287 -c com.class.name ~/path/to/jar/1.0-1.0-SNAPSHOT.jar --bootstrap.servers izac-cp-kafka:9092 --group.id test --topic bank_transaction --schema.registry http://mysr-schema-registry:8081 --CepJson """{\"keyId\": \"customer_id\",\"pattern\": [{\"patternName\": \"p1\",\"simpleCondition\":{\"columnName\": \"amount\",\"operator\": \">\",\"value\": \"50\",\"dataType\": \"Int\"}},{\"patternName\":\"p2\",\"simpleCondition\":{\"columnName\":\"amount\",\"operator\":\">\",\"value\":\"30\",\"dataType\":\"Int\"}}],\"connector\":[{\"name\":\"begin\",\"connectorType\":\"next\",\"start\":\"p1\",\"end\":\"p2\"}]}"""

要将上述命令转换为基于flink REST的发布请求,我做了以下操作-:

curl -k -v -X POST -H "Content-Type: application/json" --data '{    "entryClass":"com.class.name",   "programArgsList": [        "--bootstrap.servers izac-cp-kafka:9092",        "--group.id test",        "--topic bank_transaction",        "--schema.registry http://mysr-schema-registry:8081",        "--CepJson """{\"keyId\": \"customer_id\",\"pattern\": [{\"patternName\": \"p1\",\"simpleCondition\":{\"columnName\": \"amount\",\"operator\": \">\",\"value\": \"50\",\"dataType\": \"Int\"}},{\"patternName\":\"p2\",\"simpleCondition\":{\"columnName\":\"amount\",\"operator\":\">\",\"value\":\"30\",\"dataType\":\"Int\"}}],\"connector\":[{\"name\":\"begin\",\"connectorType\":\"next\",\"start\":\"p1\",\"end\":\"p2\"}]}""""]}' http://localhost:30287/jars/2a788e33-c92d-47c4-84af-31e3dff28666_1.0-1.0-SNAPSHOT.jar/run

但是,这产生了前面提到的错误。我只是想将上述命令行作业提交转换为基于rest api的提交到flink集群。

注意-:发布请求是针对flink集群的,该集群已经包含所需的Jar。我只想使用特定的班级提交工作。

2 个答案:

答案 0 :(得分:0)

我不认为curl会像scala一样接受"""作为字符串插值,因此肯定不会发送正确的CepJson参数,因此我将首先进行更改。

答案 1 :(得分:0)

我将上面的curl请求更改为以下内容,并且有效-:

curl -k -v -X POST -H "Content-Type: application/json" --data '{    "entryClass":"com.class.name",   "programArgsList": [        "--bootstrap.servers", "izac-cp-kafka:9092",        "--group.id"," test",        "--topic","bank_transaction",        "--schema.registry", "http://mysr-schema-registry:8081",        "--CepJson", "{\"keyId\": \"customer_id\",\"pattern\": [{\"patternName\": \"p1\",\"simpleCondition\":{\"columnName\": \"amount\",\"operator\": \">\",\"value\": \"50\",\"dataType\": \"Int\"}},{\"patternName\":\"p2\",\"simpleCondition\":{\"columnName\":\"amount\",\"operator\":\">\",\"value\":\"30\",\"dataType\":\"Int\"}}],\"connector\":[{\"name\":\"begin\",\"connectorType\":\"next\",\"start\":\"p1\",\"end\":\"p2\"}]}"]}' http://localhost:30287/jars/2a788e33-c92d-47c4-84af-31e3dff28666_1.0-1.0-SNAPSHOT.jar/run