Question

我是Hadoop Eco System的新手。

我正在单个节点上设置Hadoop Eco System。 Hadoop系统已经设置好，并且与HBASE和HIVE一起正常运行。要连接到外部数据源，我正在设置sqoop 1.99.7服务器。我发现很难设置，因为文档会产生一些混乱。有人可以一步一步地帮助我...到目前为止我所做的步骤......

Java 1.7版本 - 可用
Hadoop常用 - 已经设置并验证
已下载并安装了sqoop版本1.99.7
配置了〜/ .bashrc文件 export SQOOP_HOME = / usr / lib / sqoop export PATH = $ PATH：$ SQOOP_HOME / bin
来源bashrc文件

现在我不清楚，根据提供的文件，我在最后一天被困在这里...... 1.创建第三方罐子 - 我用了创建了一个目录/ var / lib / sqoop2 mkdir -p / var / lib / sqoop2

(Creation did not give any error and unable to locate this directory)
Hence copy all mysql-jdbc* files, postgresql-jdbc could not be done. Also
Unable to locate mysl-jdbc* files in the server path

2。我认为配置sqoop_boot starp不需要任何操作。 properties和sqoop.properties

除非完成上述步骤，否则我无法启动sqoop服务器。可以在上面纠正我以及需要做什么..提前感谢.. Sreeram

Answer 1

进一步补充一点，当我启动服务器时，我得到以下输出，并且sqoop服务器无法启动。什么是补救措施？

[root@localhost sqoop]# ./bin/sqoop.sh server start
Setting conf dir: /home/sreeram/sqoop/conf
Sqoop home directory: /home/sreeram/sqoop
Starting the Sqoop2 server...
2017-08-20 14:06:16,511 INFO  [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-08-20 14:06:16,521 INFO  [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/sreeram/sqoop/server/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/sreeram/apache-hive-2.3.0-bin/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Exception in thread "main" java.lang.RuntimeException: Failure in server initialization
    at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:68)
    at org.apache.sqoop.server.SqoopJettyServer.<init>(SqoopJettyServer.java:67)
    at org.apache.sqoop.server.SqoopJettyServer.main(SqoopJettyServer.java:177)
Caused by: org.apache.sqoop.common.SqoopException: MAPREDUCE_0002:Failure on submission engine initialization - Invalid Hadoop configuration directory (not a directory or permission issues): /etc/hadoop/conf/
    at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:97)
    at org.apache.sqoop.driver.JobManager.initialize(JobManager.java:257)
    at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:64)
    ... 2 more

Sqoop 1.99.7在Centos 7上安装

1 个答案: