Solr 数据导入

Oracle

创建data-config.xml

vi data-config.xml

<dataConfig>
  <dataSource user="usr" password="pwd" url="jdbc:oracle:thin:@host:1521:serid" driver="oracle.jdbc.driver.OracleDriver"/>
  <document name="doc_name" pk="id">
    <entity name="tbl_name" transformer="ClobTransformer" pk="id"
          query="SELECT * FROM news"
          deltaImportQuery="SELECT id,title,content FROM news where id ='${dih.delta.id}'"
          deltaQuery="SELECT id FROM news where createTime > '${dataimporter.last_index_time}'">
      <field name="id" column="id"/>
      <field name="title" column="title"/>
      <field name="content" column="content"/>
      <filed name="createTime" coiumn="createTime"/>
    </entity>
  </document>
</dataConfig>

id字段必须有

修改managed-schema或schema.xml

vi managed-schema

<field name="id" type="int" indexed="true" stored="true" multiValued="false" required="true"/>
<field name="title" type="string" indexed="true" stored="true" multiValued="false" />
<field name="content" type="string" indexed="true" stored="true" multiValued="false" />

修改solrconfig.xml

vi solrconfig.xml

<requestHandler name="/dataimport" class="solr.DataImportHandler">
  <lst name="defaults">
    <str name="config">data-config.xml</str>
  </lst>
</requestHandler>

复制solr-dataimporthandler到 lib

cp dist/solr-dataimporthandler-* server/solr-webapp/webapp/WEB-INF/lib/

复制中文分词库

cp contrib/analysis-extras/lucene-libs/lucene-analyzers-smartcn-6.6.0.jar server/solr-webapp/webapp/WEB-INF/lib/

上传到zookeeper

./zkcli.sh -zkhost hbase201,hbase202,hbase203:2181/solr -cmd putfile /configs/solr/schema.xml /usr/solr/solr-6.6.0/server/solr/configsets/data_driven_schema_configs/conf/schema.xml
./zkcli.sh -zkhost hbase201,hbase202,hbase203:2181/solr -cmd putfile /solr/configs/solr/data-config.xml /usr/solr/solr-6.6.0/server/solr/configsets/data_driven_schema_configs/conf/data-config.xml
./zkcli.sh -zkhost hbase201,hbase202,hbase203:2181/solr -cmd putfile /configs/solr/data-config-oracle.xml /usr/solr/solr-6.6.0/server/solr/configsets/data_driven_schema_configs/conf/data-config-oracle.xml

配置oracle驱动

put jdbc\lib\ojdbc6.jar

cp ojdbc6.jar /usr/solr/solr-6.6.0/server/solr-webapp/webapp/WEB-INF/lib/
scp ojdbc6.jar hbase202:/usr/solr/solr-6.6.0/server/solr-webapp/webapp/WEB-INF/lib/
scp ojdbc6.jar hbase203:/usr/solr/solr-6.6.0/server/solr-webapp/webapp/WEB-INF/lib/