【爬虫】Nutch1.15 & Solr 8.2.0 配置

Nutch

1.x vs 2.x

Nutch development has been focused mainly on 1.x for the last few years. 2.x was designed with Apache Gora, so you can have a wide variety of storage backends, which is very useful! But it hasn’t been stable for quite a few years, although it has improved very much! Unfortunately, many new features that are about crawling have been added to 1.x, not 2.x because it would take so much time for us to maintain two branches. Nutch 1.x has many bug fixes and many new features and plugins. Nutch 2.x has awesome flexible storage, but lacks many features that have been added to 1.x. On the bright side, a good number of cool features in 1.x are plugins which are easier to port ?

环境

CentOS 7.6
JDK 1.8
Nutch 1.15
Solr 8.2.0

安装过程

JAVA_HOME

export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk
export CLASSPATH=.:$JAV{A}_{H}OME/jre/lib/rt.jar:$JAVA_HOME/lib/dt.jar:$JAV{A}_{H}OME/lib/tools.ja$