Question

我正在尝试使用java实现copyFromLocal命令，下面是我的代码。

package com.hadoop;
import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;


public class CopyFromLocal {

public static void main(String[] args) throws IOException, URISyntaxException {

    Configuration conf =new Configuration();
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/core-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/mapred-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/hdfs-site.xml"));
    FileSystem fs = FileSystem.get(conf);
    Path sourcePath = new Path("/root/sample.txt");
    Path destPath = new Path("hdfs://sandbox.hortonworks.com:8020/user/Deepthy");
    if(!(fs.exists(destPath)))
    {
        System.out.println("No Such destination exists :"+destPath);
        return;
    }
fs.copyFromLocalFile(sourcePath, destPath);

}

}

我得到以下异常：

Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://sandbox.hortonworks.com:8020/user/Deepthy, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:305)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:47)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:357)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:643)
at com.amal.hadoop.CopyFromLocal.main(CopyFromLocal.java:27)

我将这些罐子添加到classpath中：
hadoop-0.20.1-core.jar
commons-logging-1.1.3.jar

请建议我哪里出错。

Answer 1

更改配置如下

conf.set("fs.default.name","hdfs://sandbox.hortonworks.com:8020");

请在目标destPath中提供相对路径，如

Path destPath = new Path("/user/Deepthy");

这将解决问题

线程“main”中的异常java.lang.IllegalArgumentException：Wrong FS：expected：file：///

1 个答案: