solr（十一）:CDH创建solr collection实例

一、目的

CDH搭建solrcloud集群，创建实例并且上传zookeeper管理。在此基础上，创建集合实例。

二、环境

1.Centos7.4
2.CHD5.15.2

三、创建实例

1.在某一个solr节点上创建默认配置文件（instancedir）

solrctl instancedir --generate /var/lib/solr/test_conf

2..创建实例并将配置文件上传到 zookeeper

solrctl instancedir --create test /var/lib/solr/test_conf

备注：上传到zookeeper的配置文件名：test

3.#在Zookeeper查看配置文件

zookeeper-client

查看

[zk: localhost:2181(CONNECTED) 1] ls /solr/configs
[collection2, test, schemalessTemplateSecure, managedTemplate, schemalessTemplate, managedTemplateSecure, predefinedTemplate, predefinedTemplateSecure]

4.#查看创建的solrhome的实例

[root@i-0zntands lib]# solrctl instancedir --list 
collection2
managedTemplate
managedTemplateSecure
predefinedTemplate
predefinedTemplateSecure
schemalessTemplate
schemalessTemplateSecure
test

5.#创建 collection

（1）创建test
 solrctl collection --create test -s 2 -c test -r 2 -m 3
（2）创建test2
solrctl collection --create test2 -s 2 -c test -r 2 -m 3

其中

[-s <numShards>]
[-a Create collection with autoAddReplicas=true]
[-c <collection.configName>]
[-r <replicationFactor>]
[-m <maxShardsPerNode>]
[-n <createNodeSet>]]
    注意：numShards*replicationFactor <= maxShardsPerNode*numNode    

6.#更新配置，更新后新建的索引会按更新后的配置创建，之前的不变。
（1）修改配置文件并且上传

[root@i-0zntands lib]# solrctl instancedir --update test /var/lib/solr/test_conf
Uploading configs from /var/lib/solr/test_instancedir/conf to i-0zntands:2181,i-6ox7jdm2:2181,i-21jclmdn:2181/solr. This may take up to a minute. 

（2）重新加载实例

[root@i-0zntands lib]# solrctl collection --reload test
[root@i-0zntands lib]# solrctl collection --reload test2

7.参考：

https://blog.csdn.net/Dr_Guo/article/details/78669052

四、solrj实现连接solr实例

1.pom依赖

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>BG</groupId>
    <artifactId>Hadoop</artifactId>
    <version>1.0-SNAPSHOT</version>


    <repositories>
        <repository>
            <id>cloudera</id>
            <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
        </repository>
    </repositories>
    <properties>
        <hadoop.version>2.6.0-cdh5.15.2</hadoop.version>
        <hbase.version>1.2.0-cdh5.15.2</hbase.version>
        <solr.version>4.10.3-cdh5.7.0</solr.version>
        <maven.compiler.source>1.8</maven.compiler.source>
        <maven.compiler.target>1.8</maven.compiler.target>
    </properties>

    <dependencies>
        <!--            <dependency>-->
        <!--                <groupId>org.apache.hadoop</groupId>-->
        <!--                <artifactId>hadoop-common</artifactId>-->
        <!--                <version>2.5.0-cdh5.2.0</version>-->
        <!--            </dependency>-->
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-hdfs</artifactId>
            <version>${hadoop.version}</version>
        </dependency>

        <!--solr-->
        <dependency>
            <groupId>org.apache.solr</groupId>
            <artifactId>solr-solrj</artifactId>
            <version>${solr.version}</version>
        </dependency>

        <!-- https://mvnrepository.com/artifact/mysql/mysql-connector-java -->
        <dependency>
            <groupId>mysql</groupId>
            <artifactId>mysql-connector-java</artifactId>
            <version>5.1.27</version>
        </dependency>
        <dependency>
            <groupId>org.apache.httpcomponents</groupId>
            <artifactId>httpclient</artifactId>
            <version>4.5.6</version>
        </dependency>
        <dependency>
            <groupId>org.apache.httpcomponents</groupId>
            <artifactId>httpcore</artifactId>
            <version>4.4.1</version>
        </dependency>

        <dependency>
            <groupId>junit</groupId>
            <artifactId>junit</artifactId>
            <version>4.10</version>
            <scope>test</scope>
        </dependency>



        <!-- https://mvnrepository.com/artifact/org.apache.commons/commons-lang3 -->
        <dependency>
            <groupId>org.apache.commons</groupId>
            <artifactId>commons-lang3</artifactId>
            <version>3.8.1</version>
        </dependency>


    </dependencies>

</project>

2.代码

package solr;

import org.apache.solr.client.solrj.impl.CloudSolrServer;
import org.apache.solr.common.SolrInputDocument;

import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.PreparedStatement;
import java.sql.ResultSet;

public class IndexManagercluster {
    /**
     * 基于cdh5.15.2的solr cloud实现建立索引，
     * @throws Exception
     */
    public void addDocument() throws Exception{
        //使用SolrJ连接集群
        //参数：zkHost是一个zookeeper集群列表
        String zkHost="ip1:2181,ip2:2181,ip3:2181/solr";

        CloudSolrServer solrserver=new CloudSolrServer(zkHost);

        //设置默认的实例collection
        solrserver.setDefaultCollection("test_ik5");
        //创建一个文档对象
        SolrInputDocument document=new SolrInputDocument();
        document.setField("id","let's try id=1");
        document.setField("title","title is hello world");

        //提交文档
        solrserver.add(document);
        //提交修改
        solrserver.commit();
    }

    public static void main(String[] args) throws Exception{

        new IndexManagercluster().addDocument();
    }
}

3.注意点

（1）zookeeper的地址时所有zookeeper的地址，而且后面要添加“/solr”。而apache版本是不需要添加的。这个两者有区别。