- 博客(11)
- 收藏
- 关注
RSS订阅转载 memo
https://gitee.com/ysc/data-generator如果你在从事大数据BI的工作，想对比一下MySQL、GreenPlum、Elasticsearch、Hive、Spark SQL、Presto、Impala、Drill、HAWQ、Druid、Pinot、Kylin、ClickHouse、Kudu等不同实现方案之间的表现，那你就需要一份标准的数据进行测试https://bl...
2019-02-28 10:21:03
173
原创 logstash doc_as_upsert error???
elasticsearch {# action => "create" action => "update"# doc_as_upsert => "true" hosts => "192.168.88.63" index => "
2018-11-01 02:08:40
1538
原创 ruby logstash filter plugin for 全局变量
ruby { init =>"@@ruby_tag= ''" } if [xid] == 1 { elasticsearch { hosts => "192.168.88.63" index => "apps_tudouni_test" query_template => "/usr/local/logstash-...
2018-10-27 00:52:35
1211
原创 查询new特征的用户并去重
GET app_test/_search{ "query": { "bool": { "must": [ { "has_parent": { "parent_type": "user_specil", "query" : {
2018-10-18 18:49:45
147
转载 logstash output ES, use join ( how to use parent)
First setup your mapping to create the join field.:(Not sure how to do this straight from logstash. If someone else does please let me know.)PUT logstash-index-name{ "mappings": { "doc": {
2018-10-18 12:04:05
478
2
原创 join 关系
PUT tudouni_zego_bulu/_mapping/_doc{ "properties": { "user_behavior_join": { "type": "join", "relations": { "user_specil": "user_act" } } }}PU
2018-10-16 16:01:09
127
原创 lookup table
GET /tudouni_zego_bulu/_search{ "query" : { "terms" : { "userid": { "index" : "user_specil_es", "type" : "doc", &
2018-10-16 12:22:36
1636
原创 ES 时间范围内过滤
GET /apps_zego_logs-2018.09.25/_search{ "size": 1, "query": { "bool": { "must": [ {"range": { "@timestamp": { "gte": "now-1h"
2018-09-26 01:46:49
7608
原创 QSL match_phrase 嵌套查询
match_phrase 嵌套查询{ "query": { "bool": { "should": [ { "match_phrase": { "body": { "query&am
2018-09-26 01:45:56
239
原创 QSL 折叠 collapse
DELETE recipesPUT recipesPOST recipes/type/_mapping{ "properties": { "name":{ "type": "text" }, "rating":{ "type": "float" },"type":{ &qu
2018-09-25 17:45:21
135
原创 Filebeat - Logstash connection reset by peer
核心操作：ES中只存储检索字段，方便快速检索、全文检索。 Mysql中存储全部字段，利用ACID事务特性。 通过关联字段建立关联，比如：news_id在ES和mysql中要有相同的值。 核心数据先通过ES快速获取Id（如news_id）,再通过Mysql二次查询。坑： filebeat和metricbeat 需要注意清空 rm data/registry , 直接连接ES时，没有数...
2018-09-25 14:31:55
3621
2
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人