Elasticsearch7.3.0导入测试数据

下载最MovieLens最小测试数据集:https://grouplens.org/datasets/movielens/
Logstash下载:https://www.elastic.co/cn/downloads/logstash
Logstash参考文档:https://www.elastic.co/guide/en/logstash/current/index.html
配置logstash.conf注意的是E:/ELK/ml-latest-small/movies.csv一定要是这个斜杠,就这个问题搞了一天,日志完全不报错。
logstash.conf:
input {
file {
path => “E:/ELK/ml-latest-small/movies.csv”
start_position => “beginning”
sincedb_path => “null”
}
}

filter {
csv {
separator => “,”
columns => [“id”,“content”,“genre”]
}

mutate {
split => { “genre” => “|” }
remove_field => [“path”, “host”,"@timestamp",“message”]
}
mutate {
split => [“content”, “(”]
add_field => { “title” => “%{[content][0]}”}
add_field => { “year” => “%{[content][1]}”}
}
mutate {
convert => {
“year” => “integer”
}
strip => [“title”]
remove_field => [“path”, “host”,"@timestamp",“message”,“content”]
}
}
output {
elasticsearch {
hosts => “http://localhost:9200
index => “movies”
document_id => “%{id}”
}
stdout {}
}
E:\logstash-7.3.0\bin\logstash.bat -f E:\logstash-7.3.0\config\logstash.conf

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值