如何在Windows 7 x64中安装和运行Nutch

时间:2012-07-14 14:41:30

标签: windows-7 installation web-crawler nutch

我想在Windows 7 x64上运行Nutch。我有来自apache.spinellicreations.com/nutch/的Nutch版本1.5.1和2。

我在wiki.apache.org/nutch/NutchTutorial使用了教程。但我在第二步搞砸了,我无法验证安装。其他步骤很难理解......

安装和使用nutch的步骤是什么?

2 个答案:

答案 0 :(得分:4)

  

按照步骤在Windows 中安装nutch

1) download and install cygwin from : https://www.cygwin.com/
2) download nutch from : http://nutch.apache.org/downloads.html
3) paste nutch downloaded and extracted folder into C:\cygwin64\home\
4) rename to apache-nutch
5) open cygwin terminal and type given commands 

 - $ cd C:
 - $ cd cygwin64
 - $ cd home
 - $ cd apache-nutch
 - $ cd src/bin
 - $ ./nutch
  

您将获得输出

Usage: nutch COMMAND
where COMMAND is one of:
 inject         inject new urls into the database
 hostinject     creates or updates an existing host table from a text file
 generate       generate new batches to fetch from crawl db
 fetch          fetch URLs marked during generate
 parse          parse URLs marked during fetch
 updatedb       update web table after parsing
 updatehostdb   update host table after parsing
 readdb         read/dump records from page database
 readhostdb     display entries from the hostDB
 index          run the plugin-based indexer on parsed batches
 elasticindex   run the elasticsearch indexer - DEPRECATED use the index command instead
 solrindex      run the solr indexer on parsed batches - DEPRECATED use the index command instead
 solrdedup      remove duplicates from solr
 solrclean      remove HTTP 301 and 404 documents from solr - DEPRECATED use the clean command instead
 clean          remove HTTP 301 and 404 documents and duplicates from indexing backends configured via plugins
 parsechecker   check the parser for a given url
 indexchecker   check the indexing filters for a given url
 plugin         load a plugin and run one of its classes main()
 nutchserver    run a (local) Nutch server on a user defined port
 webapp         run a local Nutch web application
 junit          runs the given JUnit test
 or
 CLASSNAME      run the class named CLASSNAME
Most commands print help when invoked w/o parameters.

答案 1 :(得分:1)

你没有弄乱第二步 - 你根本就没有(我猜)Cygwin已安装,所以你无法运行bash脚本。安装Cygwin(最简单)或者您可以尝试将bash脚本移植到Windows cmd文件。 (如果你这样做,你可能会发现其他依赖关系。

希望这有帮助。