SpringBoot整合Elasticsearch

最新推荐文章于 2024-08-04 00:02:15 发布
最新推荐文章于 2024-08-04 00:02:15 发布
阅读量387 收藏
点赞数
分类专栏： ELK SpringBoot 大数据 文章标签： elasticsearch java spring boot
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/L_994572281_LYA/article/details/118903580
版权
SpringBoot 同时被 3 个专栏收录
25 篇文章 1 订阅
订阅专栏
大数据
9 篇文章 0 订阅
订阅专栏
ELK
5 篇文章 0 订阅
订阅专栏

文章目录

一、配置pom

pom.xml
在这里插入图片描述
在这里插入图片描述

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
	<parent>
		<groupId>org.springframework.boot</groupId>
		<artifactId>spring-boot-starter-parent</artifactId>
		<version>2.5.2</version>
		<relativePath/> <!-- lookup parent from repository -->
	</parent>
	<groupId>com.li</groupId>
	<artifactId>li-es-api</artifactId>
	<version>0.0.1-SNAPSHOT</version>
	<name>li-es-api</name>
	<description>Demo project for Spring Boot</description>
	<properties>
		<java.version>1.8</java.version>
		<repackage.classifier/>
		<spring-native.version>0.10.1</spring-native.version>
		<!--更改默认es版本-->
		<elasticsearch.version>7.8.0</elasticsearch.version>
	</properties>
	<dependencies>
		<dependency>
			<groupId>com.alibaba</groupId>
			<artifactId>fastjson</artifactId>
			<version>1.2.62</version>
		</dependency>
		<dependency>
			<groupId>org.springframework.boot</groupId>
			<artifactId>spring-boot-starter-data-elasticsearch</artifactId>
		</dependency>
		<dependency>
			<groupId>org.springframework.boot</groupId>
			<artifactId>spring-boot-starter-web</artifactId>
		</dependency>
		<dependency>
			<groupId>org.springframework.experimental</groupId>
			<artifactId>spring-native</artifactId>
			<version>${spring-native.version}</version>
		</dependency>

		<dependency>
			<groupId>org.springframework.boot</groupId>
			<artifactId>spring-boot-devtools</artifactId>
			<scope>runtime</scope>
			<optional>true</optional>
		</dependency>
		<dependency>
			<groupId>org.springframework.boot</groupId>
			<artifactId>spring-boot-configuration-processor</artifactId>
			<optional>true</optional>
		</dependency>
		<dependency>
			<groupId>org.projectlombok</groupId>
			<artifactId>lombok</artifactId>
			<optional>true</optional>
		</dependency>
		<dependency>
			<groupId>org.springframework.boot</groupId>
			<artifactId>spring-boot-starter-test</artifactId>
			<scope>test</scope>
		</dependency>
		<dependency>
			<groupId>mysql</groupId>
			<artifactId>mysql-connector-java</artifactId>
		</dependency>
		<dependency>
			<groupId>com.baomidou</groupId>
			<artifactId>mybatis-plus-boot-starter</artifactId>
			<version>3.0.5</version>
		</dependency>
	</dependencies>

	<build>
		<plugins>
			<plugin>
				<groupId>org.springframework.boot</groupId>
				<artifactId>spring-boot-maven-plugin</artifactId>
				<configuration>
					<excludes>
						<exclude>
							<groupId>org.projectlombok</groupId>
							<artifactId>lombok</artifactId>
						</exclude>
					</excludes>
					<classifier>${repackage.classifier}</classifier>
					<image>
						<builder>paketobuildpacks/builder:tiny</builder>
						<env>
							<BP_NATIVE_IMAGE>true</BP_NATIVE_IMAGE>
						</env>
					</image>
				</configuration>
			</plugin>
			<plugin>
				<groupId>org.springframework.experimental</groupId>
				<artifactId>spring-aot-maven-plugin</artifactId>
				<version>${spring-native.version}</version>
				<executions>
					<execution>
						<id>test-generate</id>
						<goals>
							<goal>test-generate</goal>
						</goals>
					</execution>
					<execution>
						<id>generate</id>
						<goals>
							<goal>generate</goal>
						</goals>
					</execution>
				</executions>
			</plugin>
		</plugins>
	</build>
	<repositories>
		<repository>
			<id>spring-releases</id>
			<name>Spring Releases</name>
			<url>https://repo.spring.io/release</url>
			<snapshots>
				<enabled>false</enabled>
			</snapshots>
		</repository>
	</repositories>
	<pluginRepositories>
		<pluginRepository>
			<id>spring-releases</id>
			<name>Spring Releases</name>
			<url>https://repo.spring.io/release</url>
			<snapshots>
				<enabled>false</enabled>
			</snapshots>
		</pluginRepository>
	</pluginRepositories>

	<profiles>
		<profile>
			<id>native</id>
			<properties>
				<repackage.classifier>exec</repackage.classifier>
				<native-buildtools.version>0.9.1</native-buildtools.version>
			</properties>
			<dependencies>
			</dependencies>
			<build>
				<plugins>
				</plugins>
			</build>
		</profile>
	</profiles>

</project>

二、编写配置文件

ElasticSearchConfig.java


@Configuration
public class ElasticSearchConfig {
    @Bean
    public RestHighLevelClient restHighLevelClient(){
        RestHighLevelClient client = new RestHighLevelClient(
                RestClient.builder(
                        new HttpHost("127.0.0.1", 9200, "http")));
                        //new HttpHost("localhost", 9201, "http")));
                return client;
    }
    static BulkProcessor getProcessor(){
        BiConsumer<BulkRequest, ActionListener<BulkResponse>> client = null;
        return BulkProcessor.builder(client, new BulkProcessor.Listener() {

            @Override
            public void beforeBulk(long l, BulkRequest bulkRequest) {

            }

            @Override
            public void afterBulk(long l, BulkRequest bulkRequest, BulkResponse bulkResponse) {

            }

            @Override
            public void afterBulk(long l, BulkRequest bulkRequest, Throwable throwable) {

            }
        })//设置提交批处理操作的请求阀值数
                .setBulkActions(20000)
                //设置提交批处理操作的操作的请求大小阀值
                .setBulkSize(new ByteSizeValue(500, ByteSizeUnit.MB))
                // 设置刷新索引时间间隔
                .setFlushInterval(TimeValue.timeValueSeconds(30))
                //设置并发处理的线程个数
                .setConcurrentRequests(30)
                //设置回滚策略,等待时间1000ms,retry次数1次
                .setBackoffPolicy(BackoffPolicy.exponentialBackoff(
                        TimeValue.timeValueMillis(1000), 1))
                .build();

    }

}

三、编写测试函数

test.java


@SpringBootTest
class LiEsApiApplicationTests {
    @Autowired
    @Qualifier("restHighLevelClient")
    private RestHighLevelClient client;
    @Autowired
    MmsMemberCompanyService mmsMemberCompanyService;
    @Autowired
    AssociationinfoService associationinfoService;
    /*或者
     *@Autowired
     *private RestHighLevelClient restHighLevelClient;
     * */


    //索引创建
    @Test
    void testCreateIndex() throws IOException {
        //1 创建索引
        CreateIndexRequest request = new CreateIndexRequest("li_index");
        //2 客户端执行请求 IndicesClient 获得响应
        CreateIndexResponse response = client.indices().create(request, RequestOptions.DEFAULT);
        System.out.println(response);
    }

    //索引获取
    @Test
    void testGetIndex() throws IOException {
        GetIndexRequest request = new GetIndexRequest("li_index");
        boolean exists = client.indices().exists(request, RequestOptions.DEFAULT);
        System.out.println(exists);
    }

    //索引删除
    @Test
    void testDelIndex() throws IOException {
        DeleteIndexRequest request = new DeleteIndexRequest("li_index");
        AcknowledgedResponse delete = client.indices().delete(request, RequestOptions.DEFAULT);
        System.out.println(delete.isAcknowledged());
    }


    //添加文档
    @Test
    void testAddDoc() throws IOException {
        User user = new User("li", 23);
        IndexRequest request = new IndexRequest("li_index");
        //规则 PUT /li_index/_doc/1
        request.id("1");
        request.timeout(TimeValue.timeValueSeconds(1));//request.timeout("1s");
        //数据放入请求
        IndexRequest source = request.source(JSON.toJSONString(user), XContentType.JSON);
        //客户端发送请求
        IndexResponse indexResponse = client.index(request, RequestOptions.DEFAULT);
        System.out.println(indexResponse.toString());
        System.out.println(indexResponse.status());


    }


    //获取文档   GET /index/_doc/1
    @Test
    void testIsExistDoc() throws IOException {
        GetRequest request = new GetRequest("li_index", "1");
        //不获取返回的_source的上下文
        request.fetchSourceContext(new FetchSourceContext(false));
        request.storedFields("");

        boolean exists = client.exists(request, RequestOptions.DEFAULT);
        System.out.println(exists);
    }

    //获取文档信息
    @Test
    void testGetDoc() throws IOException {
        GetRequest request = new GetRequest("li_index", "1");
        GetResponse response = client.get(request, RequestOptions.DEFAULT);
        System.out.println(response.getSourceAsString());
        System.out.println(response);//和命令式 返回内容一样
    }

    //更新文档信息
    @Test
    void testUpdateDoc() throws IOException {
        UpdateRequest request = new UpdateRequest("li_index", "1");
        request.timeout("1s");

        User user = new User("张三", 56);
        UpdateRequest doc = request.doc(JSON.toJSONString(user), XContentType.JSON);
        UpdateResponse updateResponse = client.update(doc, RequestOptions.DEFAULT);
        System.out.println(updateResponse.status());
        System.out.println(updateResponse);//和命令式 返回内容一样
    }

    //删除文档记录
    @Test
    void testDelDoc() throws IOException {
        DeleteRequest request = new DeleteRequest("li_index", "1");
        request.timeout("1s");
        DeleteResponse response = client.delete(request, RequestOptions.DEFAULT);
        System.out.println(response.status());
    }

    //批量插入
    @Test
    void testBulkAddDoc() throws IOException {
        BulkRequest bulkRequest = new BulkRequest();
        bulkRequest.timeout("10s");

        ArrayList<User> users = new ArrayList<>();
        users.add(new User("java", 15));
        users.add(new User("C", 16));
        users.add(new User("C++", 17));
        users.add(new User("python", 18));
        users.add(new User("js", 19));
        users.add(new User("es", 25));
        users.add(new User("SSm", 35));
        users.add(new User("cloud", 45));

        for (int i = 0; i < users.size(); i++) {
            bulkRequest.add(new IndexRequest("li_index")
                    .source(JSON.toJSONString(users.get(i)), XContentType.JSON)
            );
        }
        BulkResponse bulk = client.bulk(bulkRequest, RequestOptions.DEFAULT);
        System.out.println(bulk.hasFailures());
    }


    //查询
    // SearchRequest搜索请求
    // SearchSourceBuilder条件构造
    // HighLightBuilder构建高亮
    //TermQueryBuilder精确查询
    // /MatchALLQueryBuilder
    //xxx QueryBuilder对应命令

    //查询
    @Test
    void testSearch() throws IOException {
        SearchRequest request = new SearchRequest(ESconst.ES_INDEX);
        //构建搜索条件
        SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
        //QueryBuilder queryBuilder = new QueryBuilder(); 不推荐
        //QueryBuilders 工具类永远的神
        TermQueryBuilder builder = QueryBuilders.termQuery("name", "java");
        searchSourceBuilder.query(builder);
        searchSourceBuilder.timeout(new TimeValue(60, TimeUnit.SECONDS));

        request.source(searchSourceBuilder);

        SearchResponse search = client.search(request, RequestOptions.DEFAULT);
        System.out.println(JSON.toJSONString(search.getHits()));
        System.out.println("===============");
        for (SearchHit hit : search.getHits().getHits()) {
            System.out.println(hit.getSourceAsMap());
        }
    }

    //批量插入
    @Test
    void testBulkAddDocTest2() throws IOException {


        int itemCount;
        int doCount = 1;
        do {
            List<MmsMemberCompany> mmsMemberCompanies = mmsMemberCompanyService.selectAll();
            itemCount = mmsMemberCompanies.size();
            if (itemCount > 0) {
                BulkRequest bulkRequest = new BulkRequest();
                bulkRequest.timeout("10s");
                for (int i = 0; i < mmsMemberCompanies.size(); i++) {
                    MmsMemberCompany mmsMemberCompany = mmsMemberCompanies.get(i);
                    bulkRequest.add(new IndexRequest("mmsmembercompany_index")
                            .source(JSON.toJSONString(mmsMemberCompany), XContentType.JSON)
                            .id(mmsMemberCompany.getId())
                    );
                    System.out.println("===================" + "i=" + i);
                }
                System.out.println("执行次数：" + doCount);
                doCount++;
                BulkResponse bulk = client.bulk(bulkRequest, RequestOptions.DEFAULT);
                System.out.println(bulk.hasFailures());
                Associationinfo associationinfo = new Associationinfo("test", mmsMemberCompanies.get(itemCount - 1).getUpdateTime(), 1);
                associationinfoService.updateInfo(associationinfo);
            }
        } while (itemCount == 3000);
    }

四、项目运用

4.1 编写pojo类

@EqualsAndHashCode(callSuper = true)
@Data
@AllArgsConstructor
@NoArgsConstructor
public class ESCompanyListReq extends StartPage {

    @NotNull
    String name;

    Long legalEntityId;

    String creditCode;

    Long id;

}

4.2 编写service类

@Service
public interface CompanySearchService {

    /**
     * @Description:模糊搜索-结果分页-内容高亮显示-按公司名字
     * @Author: lya
     * @Date: 2021/7/22 14:53
     * @Param:ESCompany
     * @Return:ESCompany
     */
    public List<ESCompanyListReq> searchCompanyPageHighLight(ESCompanyListReq param) throws IOException;


}

@Slf4j
@Service
public class CompanySearchServiceImpl implements CompanySearchService {
    @Resource
    private RestHighLevelClient restHighLevelClient;

    @Override
    //模糊搜索company-结果分页-内容高亮显示
    public List<ESCompanyListReq> searchCompanyPageHighLight(ESCompanyListReq param) throws IOException {
        SearchRequest searchRequest = new SearchRequest(ES_INDEX_company);
        //ES_INDEX_company 为静态常量自己配置即可，对应索引名称
        SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
        //分页
        searchSourceBuilder.from(param.getPageIndex());
        searchSourceBuilder.size(param.getPageSize());
        //模糊匹配
        MatchQueryBuilder matchQueryBuilder = QueryBuilders.matchQuery("name", param.getName());
        searchSourceBuilder.query(matchQueryBuilder);
        searchSourceBuilder.timeout(new TimeValue(60, TimeUnit.SECONDS));
        //高亮
        HighlightBuilder highlightBuilder = new HighlightBuilder();
        highlightBuilder.field("name");
        highlightBuilder.requireFieldMatch(true);
        highlightBuilder.preTags("<span style= 'color: red'>");
        highlightBuilder.postTags("</span>");
        searchSourceBuilder.highlighter(highlightBuilder);
        //执行搜索
        searchRequest.source(searchSourceBuilder);
        SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
        //解析结果

        ArrayList<Map<String, Object>> list = new ArrayList<>();
        for (SearchHit hit : search.getHits().getHits()) {
            //解析高亮字段
            Map<String, HighlightField> highlightFields = hit.getHighlightFields();
            HighlightField name = highlightFields.get("name");
            Map<String, Object> sourceAsMap = hit.getSourceAsMap();//原来的结果
            //原来的字段换成现在的高亮字段
            if (name != null) {
                Text[] fragments = name.fragments();
                String replace = "";
                for (Text fragment : fragments) {
                    replace += fragment;
                }
                sourceAsMap.put("name", replace);
            }
            list.add(sourceAsMap);
        }
        ArrayList<ESCompanyListReq> esCompanies = new ArrayList<>();
        for (Map<String, Object> map : list) {
            String s = JSON.toJSONString(map);//-->Map集合转换成JSON字符串
            ESCompanyListReq esCompany = JSON.parseObject(s, ESCompanyListReq.class);//将JSON字符串转换成实体类
            esCompanies.add(esCompany);
        }
        return esCompanies;
    }
}

4.3 编写controller类

@Slf4j
@RestController
@RequestMapping("/search")
public class IndexSearchController {
    @Resource
    CompanySearchService companySearchService;

    @PostMapping("/listCompanyByCompanyName")
    public Result CompanySearch(@Validated @RequestBody ESCompanyListReq req) throws IOException {
        List<ESCompanyListReq> esCompanies = companySearchService.searchCompanyPageHighLight(req);
        return Result.success(esCompanies);
    }
}

4.4 测试

在这里插入图片描述

sunny_1100
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
springboot整合ElasticSearch集群
03-29
springboot 2.0.2集成elasticsearch5.5.1，并使用集群模式，亲测可用！！！
Springboot 整合Elasticsearch
Java_Scholar0的博客
07-28 336
Springboot 整合Elasticsearch
Java中的ElasticSearch集成与实践
微赚淘客系统开发者博客
06-21 991
Id;
SpringBoot 整合 ElasticSearch
学习学习学习
05-11 5062
springBoot整合ES的基本操作
SpringBoot整合ElasticSearch
weixin_62907807的博客
07-05 3244
索引数据CRUD操作(一) 在com.yx.respository包下⾃定义ProductRepository接⼝，并继承ElasticsearchRespository接⼝。 1.创建索引数据 批量创建 查询索引数据 根据id查询数据 查询所有数据
ElasticSearch-SpringBoot整合ElasticSearch
小孔靠得住的博客
02-03 869
ElasticSearch-SpringBoot整合ElasticSearch---》浏览官方文档、创建项目的准备、正式创建项目（创建、配置）、索引的操作、文档的操作
《SpringBoot篇》16.SpringBoot整合Elasticsearch
热门推荐
陈老老老板的博客
10-06 2万+
注：公司中大部分也是对于管理日志信息使用es，我们也是，这里做简单的教学，之后会有更加完整的ES学习介绍。说明：ES（Elasticsearch）Elasticsearch是一个基于Lucene的搜索服务器。它提供了一个分布式多用户能力的全文搜索引擎，基于RESTful web接口。Elasticsearch是用Java语言开发的，并作为Apache许可条款下的开放源码发布，是一种流行的企业级搜索引擎。Elasticsearch用于云计算中，能够达到实时搜索，稳定，可靠，快速，安装使用方便。
Springboot整合ElasticSearch
qq_53422478的博客
03-13 321
Springboot整合ElasticSearch，实现全文搜索。
ElasticSearch8 - SpringBoot整合ElasticSearch
王谷雨的博客
03-25 2202
本文介绍了 SpringBoot 整合 ElasticSearch 的两种方案，但均只是简单提及，更详细的用法需要自行查看官方文档。
springboot整合elasticsearch7
jdbcmeng的博客
06-28 6576
springboot整合elasticsearch7
springboot整合elasticsearch8
winsanity的博客
10-12 4398
springboot整合elasticsearch8
SpringBoot整合Elasticsearch7.2.0的实现方法
08-25
SpringBoot整合Elasticsearch7.2.0的实现方法 在本篇文章中，我们将详细介绍如何将 Spring Boot 与 Elasticsearch 7.2.0 整合的实现方法。该方法主要通过示例代码进行详细的介绍，对大家的学习或者工作具有一定的...
SpringBoot整合Elasticsearch完整源码
02-16
这个"SpringBoot整合Elasticsearch完整源码"提供了实现这一目标的详细步骤和代码实例。以下是对相关知识点的详细说明： 1. **Spring Boot**： Spring Boot是由Pivotal Team创建的，旨在简化Spring应用的初始搭建...
SpringBoot整合elasticsearch集群
01-07
8.2.8 SpringBoot整合elasticsearch集群 Spring 是最受欢迎的企业级 Java 应用程序开发框架，数以百万的来自世界各地的开发人员使用 Spring 框架来创建性能好、易于测试、可重用的代码。Spring Boot是由Pivotal团队...
springboot整合elasticsearch7实现es数据同步，查询、相关度排序、高亮显示、自动补全搜索等功能。
03-31
springboot整合elasticsearch7，进行数据同步。elasticsearch相关度查询、排序。高亮显示；自动补全等功能。代码仅供参考，代码中有具体的注释，可以根据代码及注释内容，对自己项目架构及业务进行修改、整合。
RestAPI操作es（一）
GD2604279407的博客
08-03 465
JavaRestClient操作elasticsearch的流程基本类似。核心是方法来获取索引库的操作对象。索引库操作的基本步骤：初始化创建XxxIndexRequest。XXX是CreateGetDelete准备请求参数（Create时需要，其它是无参，可以省略）发送请求。调用方法，xxx是createexistsdelete。
谷粒商城实战笔记-116-全文检索-ElasticSearch-进阶-filter过滤
epitomizelu的专栏
08-03 598
在Elasticsearch中，布尔查询（Boolean Query）除了包含mustmust_not和should子句之外，还有一个重要的子句叫做filter。filter子句在布尔查询中扮演着过滤的角色，用于指定文档必须满足的条件，在语义上，和must非常相近，但与must不同的是，filter子句不会影响文档的相关性得分（_score以下是filter过滤作用filter子句用于过滤结果，确保返回的文档集合满足特定的条件。不计分：与must不同，filter子句不会对文档的得分产生影响。
[Git][基本操作]详细讲解
最新发布
SnowK博客
08-04 1034
[Git][基本操作]详细讲解
SpringBoot整合elasticsearch
04-27
好的，下面是SpringBoot整合elasticsearch的步骤： 1. 引入elasticsearch和spring-boot-starter-data-elasticsearch的依赖： ``` <groupId>org.elasticsearch <artifactId>elasticsearch <version>7.12.1 ...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值