Question

我正在尝试在appEngine上运行我的数据流程序但是当我使用mvn appengine：deveserver在本地运行它时，它会在下面提供访问被拒绝的异常

[INFO] WARNING: Error for /AppEngineDataFlow
[INFO] org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] access denied ("java.io.FilePermission" "C:\Users\KAPIL~1.KUM\AppData\Local\Temp" "read")
[INFO]  at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:159)
[INFO]  at org.xerial.snappy.Snappy.<clinit>(Snappy.java:47)

我正在尝试发送管道参数，如下所示：

 String[] args = new String[]{"--project=adtech-core","--stagingLocation=gs://adtech-nyt-net/Ad-Delivery/test", "--runner=BlockingDataflowPipelineRunner", "--numWorkers=10", "--filesToStage=gs://adtech-nyt-net/Ad-Delivery/stage","--maxNumWorkers=15", "--inputDate=20160617_2"}

ProcessDFPLogFilesOptions options = PipelineOptionsFactory.fromArgs(args).withValidation().as(ProcessDFPLogFilesOptions.class);     
Pipeline pipeline = Pipeline.create(options);
PCollection<String> dfp_network_data_log = pipeline.apply(TextIO.Read.named("ReadLines").from(_bucket_location).withCompressionType(TextIO.CompressionType.AUTO));

Answer 1

标准AppEngine环境缺少运行Dataflow Java SDK所需的依赖项。根据{{3}}中的建议，您需要使用flexible环境在AppEngine上运行。

AppEngine上的数据流拒绝访问

1 个答案: