Question

我从http://apache.techartifact.com/mirror/hadoop/common/hadoop-1.1.2/hadoop-1.1.2-bin.tar.gz下载了Hadoop 1.1.2。它的本机目录没有LZO本机库。

$ find~ / softwares / hadoop-1.1.2 / lib / native /

/home/deepakkv/softwares/hadoop-1.1.2/lib/native/
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-i386-32/libhadoop.so.1.0.0

/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.la
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.a
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1
/home/deepakkv/softwares/hadoop-1.1.2/lib/native/Linux-amd64-64/libhadoop.so.1.0.0

$

当我在本地模式下使用PigServer运行PIG脚本时，我看到以下错误

parquet.hadoop.BadConfigurationException：找不到类com.hadoop.compression.lzo.LzoCodec

如何获取jar文件和本机？

Answer 1

LZO已获得GPL许可，因此无法与hadoop一起发货（与基于BSD的snappy不同）您可以从https://github.com/toddlipcon/hadoop-lzo构建LZO或从https://code.google.com/p/hadoop-gpl-packing/下载

Hadoop LZO原生图书馆＆amp; JAR不可用

1 个答案: