如何使用WebHDFS knox groovy库下载文件?

时间:2016-07-21 21:23:48

标签: ibm-cloud biginsights biginsight-examples

WebHDFS examples显示了如何在hdfs中列出文件和文件夹,创建目录并使用BigInsights WebHDFS上传文件?

如何调整示例以下载BigInsights WebHDFS的文件?

1 个答案:

答案 0 :(得分:0)

knox api documentation提供了更多例子,例如

import groovy.json.JsonSlurper
import org.apache.hadoop.gateway.shell.Hadoop
import org.apache.hadoop.gateway.shell.hdfs.Hdfs

gateway = "https://localhost:8443/gateway/sample"
username = "bob"
password = "bob-password"
dataFile = "README"

session = Hadoop.login( gateway, username, password )
text = Hdfs.get( session ).from( "/tmp/example/README" ).now().string
file = new File('README') 
file << text
session.shutdown()