ELK环境搭建及es使用sql to dsl 插件

最新推荐文章于 2024-08-01 08:30:00 发布

美国大队长time

最新推荐文章于 2024-08-01 08:30:00 发布

阅读量877

点赞数 1

分类专栏： php 文章标签： php elasticsearch

本文链接：https://blog.csdn.net/qq_16579123/article/details/77775053

版权

php 专栏收录该内容

2 篇文章 0 订阅

订阅专栏

依赖

关于java JDK 依赖最好使用1.8JDK
jar :mysql-connector-java-5.1.43-bin.jar

配置文件 xxxx.conf

input {
  jdbc {
    jdbc_driver_library => "D:/wll-soft/ELK/logstash-5.5.2/mysql-connector-java-5.1.43-bin.jar"
    jdbc_driver_class => "com.mysql.jdbc.Driver"
    jdbc_connection_string => "jdbc:mysql://xxxxxx:3306/xxxx"
    jdbc_validate_connection => true
    jdbc_paging_enabled => true
    jdbc_page_size => 500
    jdbc_user => "root"
    jdbc_password => "root"
    statement => "select * from table  WHERE id > :sql_last_value"
  }
}

output {
    elasticsearch {
        hosts => ["127.0.0.1:9200"]
        index => "indexName"
    }
    stdout { codec => rubydebug }
}

启动报错(win)

Cannot locate Java installation, specified by JAVA_HOME:

 set JAVA_HOME=/XXX/XXX

Your application used more memory than the safety cap of 1G.
手动修改配置文件logstash/bin/setup.*

  set LS_HEAP_SIZE=3g

sql To DSL

github
导入数据

    logstash.bat -f xxxxx.conf

使用插件

elasticsearch-plugin.bat install es-sql-5.5.0.zip

PHP demo
下载curl扩展

composer require culr/curl

composer require elasticsearch/elasticsearch

test.php

<?php
require_once 'vendor/autoload.php';
require_once 'Elasticsearch.php';

$es = new Elasticsearch();

$curl = $es->getCURL();

$baseUri = $es->getURI();

$baseSQL = 'select * from news_info_shadow limit 1';

$sql = isset($argv[1]) ? $argv[1] : $baseSQL;

if (is_string($sql) && '' != $sql) {
    $result = $curl->get($baseUri . urlencode($sql));
    print_r(json_decode($result->response, 1)['hits']['hits']);
}

Elasticsearch.php

<?php

/**
 * Created by PhpStorm.
 * User: wang.liangliang
 * Date: 2017/9/1
 * Time: 15:58
 */
class Elasticsearch
{
    private $curl;

    private $uri;

    private $version;

    private $sql;


    public function __construct()
    {
        $this->uri = 'http://localhost:9200/_sql?sql=';
        $this->curl = new \Curl\Curl();
        $this->version = '1.0';
    }

    public function getCURL()
    {
        return $this->curl;
    }

    public function getURI()
    {
        return $this->uri;
    }

    public function setSQL($sql)
    {
        $this->sql = $sql;
    }
}