PredictionIO部署纱线上的火花簇时出错

时间:2019-03-21 11:21:01

标签: predictionio

我在纱线模式下安装带有spark clsuter的projectionIO。但是当我使用pio部署引擎时,看到以下错误:我该如何解决?

[ERROR] [OneForOneStrategy] Wrong FS: file:/home/hadoop/MyClassification/engine.json, expected: hdfs://nameservice1

[ERROR] [OneForOneStrategy] Wrong FS: file:/home/hadoop/MyClassification/engine.json, expected: hdfs://nameservice1

这是我的pio-env.sh文件:

# PredictionIO Main Configuration
SPARK_HOME=/usr/local/spark
ES_CONF_DIR=$PIO_HOME/vendors/elasticsearch-5.6.2/config
HADOOP_CONF_DIR=/usr/lib/hadoop/etc/hadoop
HBASE_CONF_DIR=/opt/app/hbase/conf

# Filesystem paths where PredictionIO uses as block storage.
PIO_FS_BASEDIR=$HOME/.pio_store
PIO_FS_ENGINESDIR=$PIO_FS_BASEDIR/engines
PIO_FS_TMPDIR=$PIO_FS_BASEDIR/tmp

# Default is to use PostgreSQL
PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta
PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=ELASTICSEARCH

PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event
PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE

PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model
PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=HDFS

# Elasticsearch Example
PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=elasticsearch
PIO_STORAGE_SOURCES_ELASTICSEARCH_HOSTS=localhost
PIO_STORAGE_SOURCES_ELASTICSEARCH_PORTS=9200
PIO_STORAGE_SOURCES_ELASTICSEARCH_SCHEMES=http
PIO_STORAGE_SOURCES_ELASTICSEARCH_CLUSTERNAME=pio
PIO_STORAGE_SOURCES_ELASTICSEARCH_HOME=$PIO_HOME/vendors/elasticsearch-5.6.2

# Local File System Example
PIO_STORAGE_SOURCES_HDFS_TYPE=hdfs
PIO_STORAGE_SOURCES_HDFS_PATH=hdfs://nameservice1/user/hadoop/mymodels

# HBase Example
PIO_STORAGE_SOURCES_HBASE_TYPE=hbase
PIO_STORAGE_SOURCES_HBASE_HOME=/opt/app/hbase

1 个答案:

答案 0 :(得分:0)

这是预测错误,但已在1094de8中修复