一、目的
CDH搭建solrcloud集群,创建实例并且上传zookeeper管理。在此基础上,创建集合实例。
二、环境
1.Centos7.4
2.CHD5.15.2
三、创建实例
1.在某一个solr节点上创建默认配置文件(instancedir)
solrctl instancedir --generate /var/lib/solr/test_conf
2..创建实例并将配置文件上传到 zookeeper
solrctl instancedir --create test /var/lib/solr/test_conf
备注:上传到zookeeper的配置文件名:test
3.#在Zookeeper查看配置文件
zookeeper-client
查看
[zk: localhost:2181(CONNECTED) 1] ls /solr/configs
[collection2, test, schemalessTemplateSecure, managedTemplate, schemalessTemplate, managedTemplateSecure, predefinedTemplate, predefinedTemplateSecure]
4.#查看创建的solrhome的实例
[root@i-0zntands lib]# solrctl instancedir --list
collection2
managedTemplate
managedTemplateSecure
predefinedTemplate
predefinedTemplateSecure
schemalessTemplate
schemalessTemplateSecure
test
5.#创建 collection
(1)创建test
solrctl collection --create test -s 2 -c test -r 2 -m 3
(2)创建test2
solrctl collection --create test2 -s 2 -c test -r 2 -m 3
其中
[-s <numShards>]
[-a Create collection with autoAddReplicas=true]
[-c <collection.configName>]
[-r <replicationFactor>]
[-m <maxShardsPerNode>]
[-n <createNodeSet>]]
注意:numShards*replicationFactor <= maxShardsPerNode*numNode
6.#更新配置,更新后新建的索引会按更新后的配置创建,之前的不变。
(1)修改配置文件并且上传
[root@i-0zntands lib]# solrctl instancedir --update test /var/lib/solr/test_conf
Uploading configs from /var/lib/solr/test_instancedir/conf to i-0zntands:2181,i-6ox7jdm2:2181,i-21jclmdn:2181/solr. This may take up to a minute.
(2)重新加载实例
[root@i-0zntands lib]# solrctl collection --reload test
[root@i-0zntands lib]# solrctl collection --reload test2
7.参考:
https://blog.csdn.net/Dr_Guo/article/details/78669052
四、solrj实现连接solr实例
1.pom依赖
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>BG</groupId>
<artifactId>Hadoop</artifactId>
<version>1.0-SNAPSHOT</version>
<repositories>
<repository>
<id>cloudera</id>
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
</repository>
</repositories>
<properties>
<hadoop.version>2.6.0-cdh5.15.2</hadoop.version>
<hbase.version>1.2.0-cdh5.15.2</hbase.version>
<solr.version>4.10.3-cdh5.7.0</solr.version>
<maven.compiler.source>1.8</maven.compiler.source>
<maven.compiler.target>1.8</maven.compiler.target>
</properties>
<dependencies>
<!-- <dependency>-->
<!-- <groupId>org.apache.hadoop</groupId>-->
<!-- <artifactId>hadoop-common</artifactId>-->
<!-- <version>2.5.0-cdh5.2.0</version>-->
<!-- </dependency>-->
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>${hadoop.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>${hadoop.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-hdfs</artifactId>
<version>${hadoop.version}</version>
</dependency>
<!--solr-->
<dependency>
<groupId>org.apache.solr</groupId>
<artifactId>solr-solrj</artifactId>
<version>${solr.version}</version>
</dependency>
<!-- https://mvnrepository.com/artifact/mysql/mysql-connector-java -->
<dependency>
<groupId>mysql</groupId>
<artifactId>mysql-connector-java</artifactId>
<version>5.1.27</version>
</dependency>
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>4.5.6</version>
</dependency>
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpcore</artifactId>
<version>4.4.1</version>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>4.10</version>
<scope>test</scope>
</dependency>
<!-- https://mvnrepository.com/artifact/org.apache.commons/commons-lang3 -->
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-lang3</artifactId>
<version>3.8.1</version>
</dependency>
</dependencies>
</project>
2.代码
package solr;
import org.apache.solr.client.solrj.impl.CloudSolrServer;
import org.apache.solr.common.SolrInputDocument;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.PreparedStatement;
import java.sql.ResultSet;
public class IndexManagercluster {
/**
* 基于cdh5.15.2的solr cloud实现建立索引,
* @throws Exception
*/
public void addDocument() throws Exception{
//使用SolrJ连接集群
//参数:zkHost是一个zookeeper集群列表
String zkHost="ip1:2181,ip2:2181,ip3:2181/solr";
CloudSolrServer solrserver=new CloudSolrServer(zkHost);
//设置默认的实例collection
solrserver.setDefaultCollection("test_ik5");
//创建一个文档对象
SolrInputDocument document=new SolrInputDocument();
document.setField("id","let's try id=1");
document.setField("title","title is hello world");
//提交文档
solrserver.add(document);
//提交修改
solrserver.commit();
}
public static void main(String[] args) throws Exception{
new IndexManagercluster().addDocument();
}
}
3.注意点
(1)zookeeper的地址时所有zookeeper的地址,而且后面要添加“/solr”。而apache版本是不需要添加的。这个两者有区别。