尝试使用jets3t访问S3时出错

时间:2014-10-30 16:55:48

标签: java hadoop amazon-s3

我知道之前已经问过这个问题,但要么没有回复,要么原先没有人要求它得到解决。我试图通过修改Hadoop的S3n接口来访问S3n存储。我正在S3n上建立一个名为Tachyon的文件系统。为此,我必须格式化文件系统。尝试这样做时我遇到了这个错误:

Connection to tachyon-master... Formatting Tachyon Worker @ tachyon-master
Removing local data under folder: /mnt/ramdisk/tachyonworker/
Connection to tachyon-master closed.
Formatting Tachyon Master @ tachyon-master
Formatting JOURNAL_FOLDER: /home/ubuntu/tachyon-0.5.0/libexec/../journal/
Exception in thread "main" java.lang.NoClassDefFoundError: org/jets3t/service/S3ServiceException
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.createDefaultStore(NativeS3FileSystem.java:280)
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.initialize(NativeS3FileSystem.java:270)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2433)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
    at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2467)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2449)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:367)
    at org.apache.hadoop.fs.Path.getFileSystem(Path.java:287)
    at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:89)
    at tachyon.UnderFileSystemHdfs.getClient(UnderFileSystemHdfs.java:56)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:69)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:54)
    at tachyon.Format.formatFolder(Format.java:32)
    at tachyon.Format.main(Format.java:59)
Caused by: java.lang.ClassNotFoundException: org.jets3t.service.S3ServiceException
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 14 more

我按照本论坛中的一些人的建议设置了我的Hadoop类路径,如下所示:

/home/ubuntu/hadoop-2.2.0/share/hadoop/common/lib/jets3t-0.9.2.jar

我下载了最新的zip文件jets3t-0.9.2.zip。我在&#34; jars&#34;中添加了罐子。此类路径的文件夹,如果上面显示了该文件夹。不过,我收到了这个错误。我很乐意提供任何帮助!

0 个答案:

没有答案