我们正尝试在SpringXD(版本1.3.1)中将数据从CSV导入HDFS。我们正在将Hortonworks用于大数据环境。我们正在尝试使用springxd doc中给出的命令,如:
xd:> job create myjob --definition "filepollhdfs --names=forename,surname,address" --deploy
xd:> stream create csvStream --definition "file --mode=ref --dir=/mycsvdir --pattern=*.csv > queue:job:myjob" --deploy
But deployment of job getting failed and getting error like:
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hadoopFs' defined in file [/Users/nxjain/Documents/spring-xd-1.3.1.RELEASE/xd/modules/job/filepollhdfs/config/filepollhdfs.xml]: Invocation of init method failed; nested exception is java.lang.StackOverflowError
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1578)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:545)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
... 49 more
Caused by: java.lang.StackOverflowError
at org.apache.hadoop.conf.Configuration.get(Configuration.java:1229)
at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:178)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:355)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
因此,我们无法通过SpringXD将数据从CSV导入到Hortonwork环境中的hdfs。这个问题有没有其他的解决方法。