学习路线:ES—>ELK—>SpringCloud—>K8s
ELK日志采集
- ELK采集NGINX日志:verynginx -> filebeat ->kafka/zk -> logstash -> es/head/kibana -> grafana
命令
- filebeat
nohup ./filebeat -e -c filebeat.yml >&/dev/null &
- kafka
- 启动
./kafka-server-start.sh ../config/server.properties 1>/usr/local/kafka_2.12-2.1.0/nohub.log 2>&1 &
- 列出全部TOPIC
./bin/kafka-topics.sh --list --zookeeper localhost:2181
- 查看TOPIC
./kafka-topics.sh --zookeeper localhost:2181 --topic "kafka-nginxaccess-log" --describe
- 生产者CLI
./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic kafka-nginxaccess-log
- zookeeper
- zk节点状态
bin/zkServer.sh status
- logstash
- 启动
nohup ./bin/logstash -f ./bin/logstash.conf &
./logstash -f ./logstash.conf
- grafana
- 启动
nohup ./bin/grafana-server -config ./conf/sample.ini &
-
全文搜索引擎 Elasticsearch 入门教程
http://www.ruanyifeng.com/blog/2017/08/elasticsearch.html -
elasticsearch: can not run elasticsearch as root
https://www.cnblogs.com/sandyyeh/p/8413724.html -
Linux查看用户列表
https://www.cnblogs.com/yiven/p/9939623.html -
Linux下如何切换用户
https://jingyan.baidu.com/article/a17d5285eb93ea8099c8f24d.html -
Elasticsearch的前后台运行与停止(tar包方式)
https://www.cnblogs.com/zlslch/p/6419826.html -
SpringBoot整合SpringDataElasticSearch操作ES
https://www.cnblogs.com/fanqisoft/p/10356698.html -
springboot操作ES
https://blog.csdn.net/qq_36348064/article/details/99230677 -
【Error】com.google.inject.CreationException: Unable to create injector
https://blog.csdn.net/awecoder/article/details/101149948 -
完整教程:Springboot 2.2整合elasticsearch 7.x (spring-boot-starter-data-elasticsearch)
https://blog.csdn.net/chengyuqiang/article/details/102938266 -
spring-data-elasticsearch cluster-nodes和cluster-name配置过时Deprecated?
https://faceghost.com/question/744291 -
elasticsearch 分片(Shards)的理解
https://blog.csdn.net/qq_38486203/article/details/80077844 -
ElasticSearch中Cluster,Node,Shard,Indices,replicas的基本概念与关系
https://blog.csdn.net/huakai_sun/article/details/79312157 -
ElasticsearchRepository 使用记录(query各种检索条件精确、模糊、分词)
https://www.cnblogs.com/lzj123/p/11821930.html -
Spring data Jpa操作ES:ElasticsearchRepository
https://my.oschina.net/fusublog/blog/3050964 -
Git多账户切换配置
https://blog.csdn.net/Nathan1987_/article/details/98546095 -
elasticsearch 拼音+ik分词,spring data elasticsearch 拼音分词
https://www.cnblogs.com/double-yuan/p/9742567.html -
CentOS7安装NodeJS
https://www.jianshu.com/p/657d58a149d0 -
tar: bzip2:无法 exec: 没有那个文件或目录
https://www.cnblogs.com/isenhome/p/6445524.html -
CentOS下安装phantomjs-2.1.1-linux-x86_64.tar.bz2
https://blog.csdn.net/liaonanfeng88/article/details/84892577 -
Linux下安装cnpm
https://www.cnblogs.com/meng2017/p/11823384.html -
安装elasticsearch-head 后台启动
https://blog.csdn.net/qq_41497111/article/details/89669482 -
Download Kibana
https://www.elastic.co/cn/downloads/kibana -
Linux下面解压.tar.gz和.gz文件解压的方式
https://blog.csdn.net/sky786905664/article/details/80927013 -
Linux安装Kibana
https://blog.csdn.net/jiahao1186/article/details/90032543 -
ElasticsearchTemplate的详细使用,完成多条件查询、匹配度查询等
https://blog.csdn.net/tianyaleixiaowu/article/details/77965257 -
linux 安装Elasticsearchhe和kibana以及启动遇到的错误解决(已成功运行)
https://blog.csdn.net/ywdhzxf/article/details/89740406 -
十二、Elasticsearch启动报/usr/local/elasticsearch-6.2.2/logs/spring-boot.log (权限不够)
https://blog.csdn.net/panchang199266/article/details/88602015 -
Kibana 用户手册 » 基础入门
https://www.elastic.co/guide/cn/kibana/current/getting-started.html -
kibana 用户教程 6.5.4
https://www.elastic.co/guide/en/kibana/6.5/index.html -
阿里云ECS下创建、启用SWAP分区详细教程
https://www.imydl.tech/lnmp/240.html -
ELK之elasticsearch删除索引
https://www.cnblogs.com/minseo/p/10949802.html -
Elasticsearch在创建索引时指定主分片个数
https://www.cnblogs.com/tank1992/p/10906840.html -
bank
curl -X PUT "localhost:9200/bank?pretty" -H 'Content-Type: application/json' -d'
{
"settings":{
"index":{
"number_of_shards":3,
"number_of_replicas":0
}
}
}
'
- shakespeare
curl -X PUT "localhost:9200/shakespeare?pretty" -H 'Content-Type: application/json' -d'
{
"settings":{
"index":{
"number_of_shards":3,
"number_of_replicas":0
}
} ,
"mappings": {
"doc": {
"properties": {
"speaker": {"type": "keyword"},
"play_name": {"type": "keyword"},
"line_id": {"type": "integer"},
"speech_number": {"type": "integer"}
}
}
}
}
'
- logstash-2015.05.18
curl -X PUT "localhost:9200/logstash-2015.05.18?pretty" -H 'Content-Type: application/json' -d'
{
"settings":{
"index":{
"number_of_shards":3,
"number_of_replicas":0
}
}
},
"mappings": {
"log": {
"properties": {
"geo": {
"properties": {
"coordinates": {
"type": "geo_point"
}
}
}
}
}
}
}
'
- 加载示例数据
curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/bank/account/_bulk?pretty' --data-binary @accounts.json
curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/shakespeare/doc/_bulk?pretty' --data-binary @shakespeare_6.0.json
curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/_bulk?pretty' --data-binary @logs.jsonl
- ElasticSearch的pretty有何作用
https://blog.csdn.net/u014078154/article/details/79415817 - [问题已处理]-[elk]-kibana6.5.4汉化
https://blog.csdn.net/xujiamin0022016/article/details/86521914 - Geo-point datatype - 地理坐标数据类型的使用(4种)
https://www.elastic.co/guide/en/elasticsearch/reference/5.6/geo-point.html - kibana 6.2 加载样本数据
https://www.cnblogs.com/shiyu404/p/10571901.html - 阿里云ECS进行ssh时,一段时间不操作就自动断开连接的解决方法
https://blog.csdn.net/woluoyifan/article/details/83958625 - apache Lucene - Query Parser Syntax
https://lucene.apache.org/core/2_9_4/queryparsersyntax.html - Nginx配置文件详解
https://www.jianshu.com/p/1593954d5faf - 关于ping不通阿里云服务器的问题
https://blog.csdn.net/zw522361/article/details/81260378 - nginx启动、重启、关闭
https://www.cnblogs.com/qijianguo/p/10686349.html - nginx [error] open() “/usr/local/nginx/logs/nginx.pid” failed的解决
https://www.cnblogs.com/lamp01/p/9005809.html - linux下maven3.3.9安装
https://blog.csdn.net/weixin_44602187/article/details/86705612 - Linux报错:bash:vi:command not find 如何解决
https://blog.csdn.net/qq_40087415/article/details/79397503 - linux安装maven及配置环境变量
https://blog.csdn.net/qq_40087415/article/details/79397503 - 如何快速清理Linux磁盘空间
https://blog.csdn.net/weixin_34167043/article/details/88726862 - LINUX下tmpfs介绍及使用
https://blog.csdn.net/haibusuanyun/article/details/17199617/ - VeryNginx详细配置说明 - 保存白名单后不能访问,需要修改JSON,- s reload
https://www.cnblogs.com/sanduzxcvbnm/p/11400349.html - ES 15 - Elasticsearch的数据类型 (text、keyword、date、object、geo等)
https://www.cnblogs.com/shoufeng/p/10692113.html - Elasticsearch之Analyze(分析过程)查看分词结果
https://blog.csdn.net/xf_87/article/details/79402489 - ElasticSearch搜索term和terms的区别
https://www.cnblogs.com/0xcafedaddy/p/6522984.html - Elasticsearch template学习
https://www.cnblogs.com/forsaken627/articles/6512379.html - zookeeper图形化的客户端工具(ZooInspector)
https://www.cnblogs.com/weiyiming007/p/11951591.html - logstash、filebeat、metricbeat后台运行
https://blog.csdn.net/weixin_41905537/article/details/103404153 - 可视化工具Grafana:简介及安装
https://www.cnblogs.com/imyalost/p/9873641.html - kafka后台启动的命令
https://www.cnblogs.com/chenmz1995/p/10595622.html
OCP组件学习
** springcloud组件预习**
- maven编译报错:java.lang.ExceptionInInitializerError: com.sun.tools.javac.code.TypeTags
https://blog.csdn.net/liubenlong007/article/details/86139598 - MAC下安装多版本JDK和切换几种方式
https://www.cnblogs.com/luodengxiong/p/5736806.html - java – Mac OS X上的Java安装位置在哪里?
https://includestdio.com/1346.html - OAuth2 和JWT区别与联系
https://blog.csdn.net/A15712399740/article/details/95233903
合欢
-
echarts 中 graph图表(关系图)如何生成节点坐标
https://segmentfault.com/q/1010000020342320 -
echarts的graph各个节点的x、y坐标该如何设置
https://segmentfault.com/q/1010000014159603 -
如何将极坐标转化为直角坐标
https://zhidao.baidu.com/question/1674632287470277267.html -
极坐标百科
https://baike.baidu.com/item/极坐标/7607962?fr=aladdin -
《JAVA编程技巧1001条》第342条:将直角坐标化为极坐标
https://blog.csdn.net/zzwu/article/details/78823705 -
如何将极坐标转换成直角坐标
https://bbs.csdn.net/topics/230036753 -
Echarts数据可视化series-graph关系图,开发全解+完美注释
https://blog.csdn.net/luanpeng825485697/article/details/76832205 -
Echarts数据可视化polar极坐标系,开发全解+完美注释
https://blog.csdn.net/luanpeng825485697/article/details/76832109 -
series-graph
https://www.echartsjs.com/zh/option.html#series-graph -
数据的视觉映射
https://www.echartsjs.com/zh/tutorial.html#数据的视觉映射 -
echartsInstance. convertToPixel
https://www.echartsjs.com/zh/api.html#echartsInstance.convertToPixel -
ECharts关系图配置:将节点替换为图片
https://bbs.csdn.net/topics/392177458 -
MybatisPlus中@TableField注解的使用
https://blog.csdn.net/BADAO_LIUMANG_QIZHI/article/details/89425635 -
Java实现家谱家族管理系统,图形化家谱家族树,单机应用程序
https://blog.csdn.net/violet_ever_garden/article/details/107145304 -
Family 族谱管理系统
https://github.com/GodLikeZeal/family
https://gitee.com/GodLikeZeal/family -
使用OrgChart插件生成家谱组织结构图
https://www.cnblogs.com/dcncy/p/9199716.html -
neo4j图谱
https://www.w3cschool.cn/neo4j/ -
Neo4j+D3展现的应用实例
https://blog.csdn.net/weixin_30342639/article/details/86756977 -
Monkiki920/TreeChart (微信小程序)
https://github.com/Monkiki920/TreeChart -
uni-app使用小程序原生组件
https://blog.csdn.net/qq_28912983/article/details/110262513