个人常用命令集锦 持续更新

Vi/Vim

1、 粘贴时行首出现很多缩进和空格
在拷贝前输入:set paste (这样的话，vim就不会启动自动缩进，而只是纯拷贝粘贴）

vi 打开文件后，直接输入:set paste，然后再按i

2、 通过vi删除空行
//dd 删除当前行。
先按esc退出编辑模式，再dd即可

3、 vi 换行
进入非编辑模式，字母o

4、Vim用快捷键快速移动光标至行尾
1）按end键
2）按住shift + 4

Docker

1、 获取完整id

docker inspect -f  '{{.Id}}' d8e703d7e303

2、 退出并不关闭容器

ctrl + p 再 ctrl+q

3、 推送镜像到私服

sudo docker push hub.docker.jiankunking.io:5000/jetty:jetty8
//冒号前后不要有空格

4、 docker build

docker build -t runoob/ubuntu:v1 . 
docker build -t  jiankunking/kafka:0.8.2.2 -f kafka.Dockerfile .

5、docker add
ADD还支持自动解压tar文件，比如ADD trusty-core-amd64.tar.gz /会线自动解压内容再COPY到在容器的/目录下。

6、删除名称或标签为none的镜像

docker rmi -f  `docker images | grep '<none>' | awk '{print $3}'`

7、容器删除删除所有未运行的容器（已经运行的删除不了，未运行的就一起被删除了）

sudo docker rm $(sudo docker ps -a -q)

删除没有被使用的镜像

docker rmi $(docker images -q)

8、docker var目录占用高问题
如果是/var/lib/docker/devicemapper/mnt占用率高
那就找出占用最高的文件

du -sh /var/lib/docker/devicemapper/mnt/*

此时的文件名称是DeviceName
然后

docker ps | awk '{print "docker inspect "$1}'|grep -v CONTAINER|sh > ./inspect.log
docker ps | awk '{print "docker inspect "$1}'|grep -v CONTAINER|sh > ./inspect.log

进入inspect查看docker信息 找到对应的正在运行的docker id

9、更新docker 重启策略

docker update --restart=always  11756183ff8a

https://docs.docker.com/engine/reference/commandline/update/

10、更新容器的内存限制

# --memory-swap -1 表示不限制
# -memory-swap	内存+交换分区大小总限制。格式同上。必须比-m设置的大
docker update -m 1024m --memory-swap -1 fea22ac3fdd7

11、容器内CPU、内存限制在/sys/fs/cgroup下

12、docker 查看容器的网络连接

#! /bin/bash
echo $1
PID=$(docker inspect -f '{{.State.Pid}}' $1)
nsenter -t $PID -n netstat |grep ESTABLISHED
　　
sudo sh docker-netstat.sh demo

第一步可以用docker top 找到pid

13、当 OOM 发生时，系统会把相关的 OOM 信息，记录到日志中。所以，我们可以在终端中执行 dmesg 命令，查看系统日志，并定位 OOM 相关的日志。（即使docker容器OOM后，也可以查看）

14、docker的/var/lib/docker目录迁移

1 停止docker服务

systemctl stop docker
2 创建新的docker目录

mkdir -p /data/docker/lib
3 迁移/var/lib/docker

rsync -avzH /var/lib/docker /data/docker/lib/

4 修改配置路径

ln  -s /data/docker/lib /var/lib/docker

5 重新加载 docker

systemctl daemon-reload
systemctl restart docker
systemctl enable docker

6 删除 /var/lib/docker

rm -rf /var/lib/docker

15、通过docker overlay2 目录名查找对应容器名
有时候经常会有个别容器占用磁盘空间特别大，这个时候就需要通过docker overlay2 目录名查找对应容器名：
首先进入到 /var/lib/docker/overlay2 目录下,查看谁占用的较多

如图所示，占用空间最大的目录为6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35

再通过目录名查找容器名

 docker ps -q | xargs docker inspect --format '{{.State.Pid}}, {{.Id}}, {{.Name}}, {{.GraphDriver.Data.WorkDir}}' | grep 6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35

-- 输出依次为，进程pid、容器ID、容器名、存储work路径，即可确定是哪个容器
18748, a43a3a22b0293fc001a7b325d18ed76af207f838959bbd405d792e96eafae294, /console_jumpserver_1567680881201, /var/lib/docker/overlay/6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35/work

containerd

1、从宿主机拷贝文件到containerd

// 1、通过找到进程id
// 2、在宿主机从进入containerd所在目录
// 3、该目录就是containerd中的根目录/
cd /proc/<PID>/root

Idea

1、 idea 类中函数全部折叠
ctrl + shift + 减号
2、 idea 类中函数全部展开
ctrl + shift + 加号
3、 idea 回到调用方法
ctrl + alt + f7
4、查找接口的实现类
ctrl + alt +B
5、查看类或接口的继承关系
ctrl + h
6、查看一个方法的调用
Ctrl + Alt + H
7、重复代码快速重构(抽取重复代码)
Alt+Shift+M

Kafka

1、 查看kafka主题数据

bin/kafka-topics.sh --zookeeper 10.138.22.194:2181 --describe --topic count_test_one

2、 手动调用消费端

./kafka-console-consumer.sh --zookeeper localhost:2181 --topic count_test_one --from-beginning
./kafka-console-consumer.sh --zookeeper localhost:2181 --topic count_test_one
./kafka-console-consumer.sh --bootstrap-server 10.119.37.115:9092,10.119.37.147:9092,10.119.37.148:9092   --topic dubbo |grep xiaoneng

// 2.0 
bin/kafka-console-consumer.sh --bootstrap-server 10.163.111.195:9092 --topic qd-aliyun --from-beginning

3、kafka启动

bin/kafka-server-start.sh -daemon config/server.properties

4、kafka 消费端启动

java -jar monitor-kafka-consumer-0.0.1-SNAPSHOT.jar -Dtopic=custom

5、查看kafka所有topic

bin/kafka-topics.sh --list --zookeeper localhost:2181
bin/kafka-topics.sh  --bootstrap-server 127.0.0.1:9092 --list

6、kafka消费端 消费指定主题

./kafka-console-consumer.sh --zookeeper localhost:2181 --topic xiaonengdubbo2
// 2.x
./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mysql-prod.console.org --partition 1

7、获取kafka中所有组

./kafka-consumer-groups.sh  --bootstrap-server 127.0.0.1:9092 --list

8、查看kafka消费端堆积量

./kafka-consumer-groups.sh  --bootstrap-server 127.0.0.1:9092 --group interconn --describe

9、查看kafka版本

find ./libs/ -name 'kafka_*.jar.asc' |head -n1 | cut -d'/' -f3

10、查看kafka某个topic下partition信息

./kafka-topics.sh --zookeeper 10.138.1.1:2181  --topic dubbo --describe 

11、修改partition数量

./kafka-topics.sh --alter  --zookeeper 10.230.204.83:2181,10.230.204.84:2181,10.230.204.85:2181 --topic cdc --partitions 6

12、修改副本数

配置文件：

83 84 85是kafka broker id

{
  "version": 1,
  "partitions": [
    {
      "topic": "cdc",
      "partition": 0,
      "replicas": [
        83,
        84
      ]
    },
    {
      "topic": "cdc",
      "partition": 1,
      "replicas": [
        84,
        85
      ]
    },
    {
      "topic": "cdc",
      "partition": 2,
      "replicas": [
        83,
        85
      ]
    },
    {
      "topic": "cdc",
      "partition": 3,
      "replicas": [
        84,
        85
      ]
    },
    {
      "topic": "cdc",
      "partition": 4,
      "replicas": [
        83,
        84
      ]
    },
    {
      "topic": "cdc",
      "partition": 5,
      "replicas": [
        83,
        85
      ]
    }
  ]
}

执行脚本：

./kafka-reassign-partitions.sh --zookeeper 10.230.204.83:2181,10.230.204.84:2181,10.230.204.85:2181 --reassignment-json-file reassignment.json --execute

Git

1、 git忽略文件命令

git update-index --assume-unchanged FILE 在FILE处输入要忽略的文件。

2、git rebase

# 引起冲突的commits会被丢弃，因此，在使用skip时请慎重。
git rebase --skip
# 可以运行git rebase –continue继续直到完成
git rebase --continue 

3、git reflog
显示整个本地仓储的commit, 包括所有branch的commit, 甚至包括已经撤销的commit, 只要HEAD发生了变化, 就会在reflog里面看得到. git log只包括当前分支的commit.
4、git log --graph
–graph 参数会根据分枝提交历史绘出图像。这个命令通常和–oneline，–decorate一起使用

git log --graph --oneline --decorate

5、git log
可以使用–pretty=format:""来自定义输出的格式。输出格式有点像printf中的占位符。
举个例子，下面的命令中，%cn,%h和%cd会被提交者姓名，commit的hash缩写，提交的日期占据

git log --pretty=format:"%cn committed %h on %cd"

格式化参考
https://www.kernel.org/pub/software/scm/git/docs/git-log.html#_pretty_formats
6、git fetch
git fetch命令用于从另一个存储库下载对象和引用。
7、丢弃工作区的修改
命令git checkout – readme.txt意思就是，把readme.txt文件在工作区的修改全部撤销，这里有两种情况：
一种是readme.txt自修改后还没有被放到暂存区，现在，撤销修改就回到和版本库一模一样的状态；
一种是readme.txt已经添加到暂存区后，又作了修改，现在，撤销修改就回到添加到暂存区后的状态。
总之，就是让这个文件回到最近一次git commit或git add时的状态。
8、采用主分支上的/response.go文件

git checkout c4a651ba96d25a15adbecb21025f0d1d60901b6a pkg/models/response.go

9、终止git log 命令
按 q ，然后回车， 即可退出

Maven

1、打包时跳过测试

mvn clean package  -Dmaven.test.skip=true

Zookeeper

1、zookeeper 节点 命令查看

./zkCli.sh -timeout 5000 -r -server localhost:2181

2、查看zk集群状态

echo mntr | nc localhost 2181

leader节点返回示例：

Zookeeper version: 3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
Clients:
 /127.0.0.1:39436[1](queued=0,recved=493,sent=493)
 /127.0.0.1:39526[1](queued=0,recved=479,sent=479)
 /127.0.0.1:39510[1](queued=0,recved=507,sent=507)
 /127.0.0.1:39410[1](queued=0,recved=459,sent=459)
 /127.0.0.1:39424[1](queued=0,recved=517,sent=517)
 /0:0:0:0:0:0:0:1:41446[0](queued=0,recved=1,sent=0)
 /127.0.0.1:39416[1](queued=0,recved=494,sent=494)
 /127.0.0.1:39404[1](queued=0,recved=491,sent=491)
 /127.0.0.1:39514[1](queued=0,recved=486,sent=486)
 /127.0.0.1:39496[1](queued=0,recved=490,sent=490)

Latency min/avg/max: 0/0/12
Received: 4770
Sent: 4453
Connections: 10
Outstanding: 0
Zxid: 0x5000000f4
Mode: leader
Node count: 313
Proposal sizes last/min/max: 36/32/36
You have mail in /var/spool/mail/root

follower节点返回：

zk_version      3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
zk_avg_latency  0
zk_max_latency  12
zk_min_latency  0
zk_packets_received     190
zk_packets_sent 189
zk_num_alive_connections        7
zk_outstanding_requests 0
zk_server_state follower
zk_znode_count  313
zk_watch_count  2
zk_ephemerals_count     4
zk_approximate_data_size        25605
zk_open_file_descriptor_count   106
zk_max_file_descriptor_count    65536

如果提示：mntr is not executed because it is not in the whitelist.
解决办法,修改 conf/zoo.cfg 添加以下属性

#开启四字命令
4lw.commands.whitelist=*

Nginx

1、nginx启动（nginx安装目录地址 -c nginx配置文件地址）

/usr/local/nginx/sbin/nginx -c /usr/local/nginx/conf/nginx.conf

2、查看nginx配置文件

nginx -t

3、nginx 重启

查找当前nginx进程号，然后输入命令：kill -HUP 进程号 实现重启nginx服务

MySQL

1、查看mysql表分区

SELECT
	partition_name part,
	partition_expression expr,
	partition_description descr,
	table_rows
FROM
	information_schema. PARTITIONS
WHERE
	table_schema = SCHEMA ()
AND table_name = 'application_hour_count';

2、mysql 外键
禁用外键约束：

SET FOREIGN_KEY_CHECKS=0;

启动外键约束：

SET FOREIGN_KEY_CHECKS=1;

3、Mysql统计所有表数据量

SELECT
  TABLE_NAME,
  TABLE_ROWS
FROM
  `information_schema`.`tables`
WHERE
  `table_schema` = 'YOUR_DB_NAME'
ORDER BY
  TABLE_ROWS DESC;

4、MySQL查询表中重复字段和重复的次数

SELECT
  user_name,
  count(*) AS count
FROM
  USER
GROUP BY
  user_name
HAVING
  count > 1
ORDER BY
  count DESC;

5、查看mysql的配置变量

show VARIABLES

具体结果

auto_increment_increment	1
auto_increment_offset	1
autocommit	ON
automatic_sp_privileges	OFF
avoid_temporal_upgrade	OFF
back_log	512
basedir	/usr/local/mysql/
big_tables	OFF
bind_address	*
binlog_cache_size	32768
binlog_checksum	CRC32
binlog_direct_non_transactional_updates	OFF
binlog_error_action	ABORT_SERVER
binlog_format	ROW
binlog_group_commit_sync_delay	0
binlog_group_commit_sync_no_delay_count	0
binlog_gtid_simple_recovery	ON
binlog_max_flush_queue_time	0
binlog_order_commits	ON
binlog_row_image	FULL
binlog_rows_query_log_events	ON
binlog_stmt_cache_size	32768
binlog_transaction_dependency_history_size	25000
binlog_transaction_dependency_tracking	COMMIT_ORDER
block_encryption_mode	aes-128-ecb
bulk_insert_buffer_size	8388608
character_set_client	utf8mb4
character_set_connection	utf8mb4
character_set_database	utf8
character_set_filesystem	binary
character_set_results	utf8mb4
character_set_server	utf8
character_set_system	utf8
character_sets_dir	/usr/local/mysql/share/charsets/
check_proxy_users	OFF
collation_connection	utf8mb4_general_ci
collation_database	utf8_general_ci
collation_server	utf8_general_ci
completion_type	NO_CHAIN
concurrent_insert	AUTO
connect_timeout	10
core_file	OFF
datadir	/data/mysql/
date_format	%Y-%m-%d
datetime_format	%Y-%m-%d %H:%i:%s
default_authentication_plugin	mysql_native_password
default_password_lifetime	0
default_storage_engine	InnoDB
default_tmp_storage_engine	InnoDB
default_week_format	0
delay_key_write	ON
delayed_insert_limit	100
delayed_insert_timeout	300
delayed_queue_size	1000
disabled_storage_engines	
disconnect_on_expired_password	ON
div_precision_increment	4
end_markers_in_json	OFF
enforce_gtid_consistency	OFF
eq_range_index_dive_limit	200
error_count	0
event_scheduler	OFF
expire_logs_days	7
explicit_defaults_for_timestamp	ON
external_user	
flush	OFF
flush_time	0
foreign_key_checks	ON
ft_boolean_syntax	+ -><()~*:""&|
ft_max_word_len	84
ft_min_word_len	4
ft_query_expansion_limit	20
ft_stopword_file	(built-in)
general_log	OFF
general_log_file	/data/mysql/cmp24.log
group_concat_max_len	10240
gtid_executed_compression_period	1000
gtid_mode	OFF
gtid_next	AUTOMATIC
gtid_owned	
gtid_purged	
have_compress	YES
have_crypt	YES
have_dynamic_loading	YES
have_geometry	YES
have_openssl	DISABLED
have_profiling	YES
have_query_cache	YES
have_rtree_keys	YES
have_ssl	DISABLED
have_statement_timeout	YES
have_symlink	YES
host_cache_size	753
hostname	cmp24
identity	0
ignore_builtin_innodb	OFF
ignore_db_dirs	
init_connect	
init_file	
init_slave	
innodb_adaptive_flushing	ON
innodb_adaptive_flushing_lwm	10
innodb_adaptive_hash_index	ON
innodb_adaptive_hash_index_parts	8
innodb_adaptive_max_sleep_delay	150000
innodb_api_bk_commit_interval	5
innodb_api_disable_rowlock	OFF
innodb_api_enable_binlog	OFF
innodb_api_enable_mdl	OFF
innodb_api_trx_level	0
innodb_autoextend_increment	64
innodb_autoinc_lock_mode	1
innodb_buffer_pool_chunk_size	134217728
innodb_buffer_pool_dump_at_shutdown	ON
innodb_buffer_pool_dump_now	OFF
innodb_buffer_pool_dump_pct	25
innodb_buffer_pool_filename	ib_buffer_pool
innodb_buffer_pool_instances	8
innodb_buffer_pool_load_abort	OFF
innodb_buffer_pool_load_at_startup	ON
innodb_buffer_pool_load_now	OFF
innodb_buffer_pool_size	10737418240
innodb_change_buffer_max_size	25
innodb_change_buffering	all
innodb_checksum_algorithm	crc32
innodb_checksums	ON
innodb_cmp_per_index_enabled	OFF
innodb_commit_concurrency	0
innodb_compression_failure_threshold_pct	5
innodb_compression_level	6
innodb_compression_pad_pct_max	50
innodb_concurrency_tickets	5000
innodb_data_file_path	ibdata1:12M:autoextend
innodb_data_home_dir	/data/mysql
innodb_deadlock_detect	ON
innodb_default_row_format	dynamic
innodb_disable_sort_file_cache	OFF
innodb_doublewrite	ON
innodb_fast_shutdown	1
innodb_file_format	Barracuda
innodb_file_format_check	ON
innodb_file_format_max	Barracuda
innodb_file_per_table	ON
innodb_fill_factor	100
innodb_flush_log_at_timeout	1
innodb_flush_log_at_trx_commit	1
innodb_flush_method	
innodb_flush_neighbors	1
innodb_flush_sync	ON
innodb_flushing_avg_loops	30
innodb_force_load_corrupted	OFF
innodb_force_recovery	0
innodb_ft_aux_table	
innodb_ft_cache_size	8000000
innodb_ft_enable_diag_print	OFF
innodb_ft_enable_stopword	ON
innodb_ft_max_token_size	84
innodb_ft_min_token_size	3
innodb_ft_num_word_optimize	2000
innodb_ft_result_cache_limit	2000000000
innodb_ft_server_stopword_table	
innodb_ft_sort_pll_degree	2
innodb_ft_total_cache_size	640000000
innodb_ft_user_stopword_table	
innodb_io_capacity	200
innodb_io_capacity_max	2000
innodb_large_prefix	ON
innodb_lock_wait_timeout	3600
innodb_locks_unsafe_for_binlog	OFF
innodb_log_buffer_size	16777216
innodb_log_checksums	ON
innodb_log_compressed_pages	ON
innodb_log_file_size	1073741824
innodb_log_files_in_group	2
innodb_log_group_home_dir	./
innodb_log_write_ahead_size	8192
innodb_lru_scan_depth	1024
innodb_max_dirty_pages_pct	75.000000
innodb_max_dirty_pages_pct_lwm	0.000000
innodb_max_purge_lag	0
innodb_max_purge_lag_delay	0
innodb_max_undo_log_size	1073741824
innodb_monitor_disable	
innodb_monitor_enable	
innodb_monitor_reset	
innodb_monitor_reset_all	
innodb_numa_interleave	OFF
innodb_old_blocks_pct	37
innodb_old_blocks_time	1000
innodb_online_alter_log_max_size	134217728
innodb_open_files	1024
innodb_optimize_fulltext_only	OFF
innodb_page_cleaners	4
innodb_page_size	16384
innodb_print_all_deadlocks	OFF
innodb_purge_batch_size	300
innodb_purge_rseg_truncate_frequency	128
innodb_purge_threads	4
innodb_random_read_ahead	OFF
innodb_read_ahead_threshold	56
innodb_read_io_threads	4
innodb_read_only	OFF
innodb_replication_delay	0
innodb_rollback_on_timeout	OFF
innodb_rollback_segments	128
innodb_sort_buffer_size	1048576
innodb_spin_wait_delay	6
innodb_stats_auto_recalc	ON
innodb_stats_include_delete_marked	OFF
innodb_stats_method	nulls_equal
innodb_stats_on_metadata	OFF
innodb_stats_persistent	ON
innodb_stats_persistent_sample_pages	20
innodb_stats_sample_pages	8
innodb_stats_transient_sample_pages	8
innodb_status_output	OFF
innodb_status_output_locks	OFF
innodb_strict_mode	ON
innodb_support_xa	ON
innodb_sync_array_size	1
innodb_sync_spin_loops	30
innodb_table_locks	ON
innodb_temp_data_file_path	ibtmp1:12M:autoextend
innodb_thread_concurrency	0
innodb_thread_sleep_delay	10000
innodb_tmpdir	
innodb_undo_directory	./
innodb_undo_log_truncate	OFF
innodb_undo_logs	128
innodb_undo_tablespaces	0
innodb_use_native_aio	ON
innodb_version	5.7.23
innodb_write_io_threads	4
insert_id	0
interactive_timeout	600
internal_tmp_disk_storage_engine	InnoDB
join_buffer_size	4194304
keep_files_on_create	OFF
key_buffer_size	8388608
key_cache_age_threshold	300
key_cache_block_size	1024
key_cache_division_limit	100
keyring_operations	ON
large_files_support	ON
large_page_size	0
large_pages	OFF
last_insert_id	0
lc_messages	en_US
lc_messages_dir	/usr/local/mysql/share/
lc_time_names	en_US
license	GPL
local_infile	ON
lock_wait_timeout	31536000
locked_in_memory	OFF
log_bin	ON
log_bin_basename	/data/mysql/mysql-binlog
log_bin_index	/data/mysql/mysql-binlog.index
log_bin_trust_function_creators	ON
log_bin_use_v1_row_events	OFF
log_builtin_as_identified_by_password	OFF
log_error	/data/mysql/error.log
log_error_verbosity	3
log_output	FILE
log_queries_not_using_indexes	OFF
log_slave_updates	ON
log_slow_admin_statements	OFF
log_slow_slave_statements	OFF
log_statements_unsafe_for_binlog	ON
log_syslog	OFF
log_syslog_facility	daemon
log_syslog_include_pid	ON
log_syslog_tag	
log_throttle_queries_not_using_indexes	0
log_timestamps	SYSTEM
log_warnings	2
long_query_time	1.000000
low_priority_updates	OFF
lower_case_file_system	OFF
lower_case_table_names	1
master_info_repository	FILE
master_verify_checksum	OFF
max_allowed_packet	67108864
max_binlog_cache_size	18446744073709547520
max_binlog_size	1073741824
max_binlog_stmt_cache_size	18446744073709547520
max_connect_errors	200000
max_connections	3000
max_delayed_threads	20
max_digest_length	1024
max_error_count	64
max_execution_time	0
max_heap_table_size	33554432
max_insert_delayed_threads	20
max_join_size	18446744073709551615
max_length_for_sort_data	1024
max_points_in_geometry	65536
max_prepared_stmt_count	16382
max_relay_log_size	0
max_seeks_for_key	18446744073709551615
max_sort_length	1024
max_sp_recursion_depth	0
max_tmp_tables	32
max_user_connections	0
max_write_lock_count	18446744073709551615
metadata_locks_cache_size	1024
metadata_locks_hash_instances	8
min_examined_row_limit	0
multi_range_count	256
myisam_data_pointer_size	6
myisam_max_sort_file_size	9223372036853727232
myisam_mmap_size	18446744073709551615
myisam_recover_options	OFF
myisam_repair_threads	1
myisam_sort_buffer_size	8388608
myisam_stats_method	nulls_unequal
myisam_use_mmap	OFF
mysql_native_password_proxy_users	OFF
net_buffer_length	16384
net_read_timeout	30
net_retry_count	10
net_write_timeout	60
new	OFF
ngram_token_size	2
offline_mode	OFF
old	OFF
old_alter_table	OFF
old_passwords	0
open_files_limit	65535
optimizer_prune_level	1
optimizer_search_depth	62
optimizer_switch	index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,engine_condition_pushdown=on,index_condition_pushdown=on,mrr=on,mrr_cost_based=on,block_nested_loop=on,batched_key_access=off,materialization=on,semijoin=on,loosescan=on,firstmatch=on,duplicateweedout=on,subquery_materialization_cost_based=on,use_index_extensions=on,condition_fanout_filter=on,derived_merge=on
optimizer_trace	enabled=off,one_line=off
optimizer_trace_features	greedy_search=on,range_optimizer=on,dynamic_range=on,repeated_subselect=on
optimizer_trace_limit	1
optimizer_trace_max_mem_size	16384
optimizer_trace_offset	-1
parser_max_mem_size	18446744073709551615
performance_schema	ON
performance_schema_accounts_size	-1
performance_schema_digests_size	10000
performance_schema_events_stages_history_long_size	10000
performance_schema_events_stages_history_size	10
performance_schema_events_statements_history_long_size	10000
performance_schema_events_statements_history_size	10
performance_schema_events_transactions_history_long_size	10000
performance_schema_events_transactions_history_size	10
performance_schema_events_waits_history_long_size	10000
performance_schema_events_waits_history_size	10
performance_schema_hosts_size	-1
performance_schema_max_cond_classes	80
performance_schema_max_cond_instances	-1
performance_schema_max_digest_length	1024
performance_schema_max_file_classes	80
performance_schema_max_file_handles	32768
performance_schema_max_file_instances	-1
performance_schema_max_index_stat	-1
performance_schema_max_memory_classes	320
performance_schema_max_metadata_locks	-1
performance_schema_max_mutex_classes	210
performance_schema_max_mutex_instances	-1
performance_schema_max_prepared_statements_instances	-1
performance_schema_max_program_instances	-1
performance_schema_max_rwlock_classes	40
performance_schema_max_rwlock_instances	-1
performance_schema_max_socket_classes	10
performance_schema_max_socket_instances	-1
performance_schema_max_sql_text_length	1024
performance_schema_max_stage_classes	150
performance_schema_max_statement_classes	193
performance_schema_max_statement_stack	10
performance_schema_max_table_handles	-1
performance_schema_max_table_instances	-1
performance_schema_max_table_lock_stat	-1
performance_schema_max_thread_classes	50
performance_schema_max_thread_instances	-1
performance_schema_session_connect_attrs_size	512
performance_schema_setup_actors_size	-1
performance_schema_setup_objects_size	-1
performance_schema_users_size	-1
pid_file	/data/mysql/mysql.pid
plugin_dir	/usr/local/mysql/lib/plugin/
port	3306
preload_buffer_size	32768
profiling	ON
profiling_history_size	15
protocol_version	10
proxy_user	
pseudo_slave_mode	OFF
pseudo_thread_id	42389158
query_alloc_block_size	8192
query_cache_limit	1048576
query_cache_min_res_unit	4096
query_cache_size	0
query_cache_type	OFF
query_cache_wlock_invalidate	OFF
query_prealloc_size	8192
rand_seed1	0
rand_seed2	0
range_alloc_block_size	4096
range_optimizer_max_mem_size	8388608
rbr_exec_mode	STRICT
read_buffer_size	131072
read_only	OFF
read_rnd_buffer_size	262144
relay_log	
relay_log_basename	/data/mysql/cmp24-relay-bin
relay_log_index	/data/mysql/cmp24-relay-bin.index
relay_log_info_file	relay-log.info
relay_log_info_repository	FILE
relay_log_purge	ON
relay_log_recovery	OFF
relay_log_space_limit	0
report_host	
report_password	
report_port	3306
report_user	
require_secure_transport	OFF
rpl_stop_slave_timeout	31536000
secure_auth	ON
secure_file_priv	NULL
server_id	3306100
server_id_bits	32
server_uuid	7b607ec8-2525-11e9-86f1-52f6795368e8
session_track_gtids	OFF
session_track_schema	ON
session_track_state_change	OFF
session_track_system_variables	time_zone,autocommit,character_set_client,character_set_results,character_set_connection
session_track_transaction_info	OFF
sha256_password_proxy_users	OFF
show_compatibility_56	OFF
show_create_table_verbosity	OFF
show_old_temporals	OFF
skip_external_locking	ON
skip_name_resolve	OFF
skip_networking	OFF
skip_show_database	OFF
slave_allow_batching	OFF
slave_checkpoint_group	512
slave_checkpoint_period	300
slave_compressed_protocol	OFF
slave_exec_mode	STRICT
slave_load_tmpdir	/tmp
slave_max_allowed_packet	1073741824
slave_net_timeout	60
slave_parallel_type	DATABASE
slave_parallel_workers	0
slave_pending_jobs_size_max	16777216
slave_preserve_commit_order	OFF
slave_rows_search_algorithms	TABLE_SCAN,INDEX_SCAN
slave_skip_errors	OFF
slave_sql_verify_checksum	ON
slave_transaction_retries	10
slave_type_conversions	
slow_launch_time	2
slow_query_log	ON
slow_query_log_file	/data/mysql/slow_query.log
socket	/data/mysql/mysql.sock
sort_buffer_size	4194304
sql_auto_is_null	OFF
sql_big_selects	ON
sql_buffer_result	OFF
sql_log_bin	ON
sql_log_off	OFF
sql_mode	STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
sql_notes	ON
sql_quote_show_create	ON
sql_safe_updates	OFF
sql_select_limit	18446744073709551615
sql_slave_skip_counter	0
sql_warnings	OFF
ssl_ca	
ssl_capath	
ssl_cert	
ssl_cipher	
ssl_crl	
ssl_crlpath	
ssl_key	
stored_program_cache	256
super_read_only	OFF
sync_binlog	0
sync_frm	ON
sync_master_info	10000
sync_relay_log	10000
sync_relay_log_info	10000
system_time_zone	CST
table_definition_cache	912
table_open_cache	1024
table_open_cache_instances	16
thread_cache_size	512
thread_handling	one-thread-per-connection
thread_stack	262144
time_format	%H:%i:%s
time_zone	SYSTEM
timestamp	1647388592.535236
tls_version	TLSv1,TLSv1.1
tmp_table_size	33554432
tmpdir	/tmp
transaction_alloc_block_size	8192
transaction_allow_batching	OFF
transaction_isolation	READ-COMMITTED
transaction_prealloc_size	4096
transaction_read_only	OFF
transaction_write_set_extraction	OFF
tx_isolation	READ-COMMITTED
tx_read_only	OFF
unique_checks	ON
updatable_views_with_limit	YES
version	5.7.23-log
version_comment	MySQL Community Server (GPL)
version_compile_machine	x86_64
version_compile_os	el7
wait_timeout	600
warning_count	0

6、哪些事务正在等待，哪些事务正在阻塞：

// 5.7 方式一 
SELECT
  r.trx_id waiting_trx_id,
  r.trx_mysql_thread_id waiting_thread,
  r.trx_query waiting_query,
  b.trx_id blocking_trx_id,
  b.trx_mysql_thread_id blocking_thread,
  b.trx_query blocking_query
FROM       information_schema.innodb_lock_waits w
INNER JOIN information_schema.innodb_trx b
  ON b.trx_id = w.blocking_trx_id
INNER JOIN information_schema.innodb_trx r
  ON r.trx_id = w.requesting_trx_id;

// 5.7 方式二(普通账号不一定有权限)
SELECT
  waiting_trx_id,
  waiting_pid,
  waiting_query,
  blocking_trx_id,
  blocking_pid,
  blocking_query
FROM sys.innodb_lock_waits;

// 8.X 方式一
SELECT
  r.trx_id waiting_trx_id,
  r.trx_mysql_thread_id waiting_thread,
  r.trx_query waiting_query,
  b.trx_id blocking_trx_id,
  b.trx_mysql_thread_id blocking_thread,
  b.trx_query blocking_query
FROM       performance_schema.data_lock_waits w
INNER JOIN information_schema.innodb_trx b
  ON b.trx_id = w.blocking_engine_transaction_id
INNER JOIN information_schema.innodb_trx r
  ON r.trx_id = w.requesting_engine_transaction_id;
  
// 8.x 方式二(普通账号不一定有权限)
SELECT
  waiting_trx_id,
  waiting_pid,
  waiting_query,
  blocking_trx_id,
  blocking_pid,
  blocking_query
FROM sys.innodb_lock_waits;

整理自:

• https://dev.mysql.com/doc/refman/8.0/en/innodb-information-schema-examples.html
• https://dev.mysql.com/doc/refman/5.7/en/innodb-information-schema-examples.html

7、How to select static values column?=> 如何将固定值转成列(这里主要是为了当做临时表)

SELECT 1 as Value
UNION
SELECT 2 as Value
UNION
SELECT 3 as Value

8、

MongoDB

1、登陆MongoDB

sudo ssh jiankunking@10.138.40.221
sudo docker ps
sudo docker exec -it 83aa14b64901 /bin/bash
mongo

2、基础查询

rs0:PRIMARY> show dbs
admin               0.000GB
console-web         0.452GB


rs0:PRIMARY> use console-web
switched to db console-web
rs0:PRIMARY> show collections
clusters
fileuploads

rs0:PRIMARY> 
rs0:PRIMARY> 
rs0:PRIMARY> db.clusters.find().pretty()

Elasticsearch

Elasticsearch 常用命令

Prometheus

1、重新加载文件

curl -XPOST  http://127.0.0.1:9090/-/reload 

Kibana

1、kibana启动

nohup ./bin/kibana >/dev/null &
bin/kibana-plugin install file:///usr/local/x-pack-5.6.9.zip

2、kibana查看非空字段

_exists_:labels

Consul

1、查询当前集群下拥有的datacenter信息

consul members -wan

Node.js

1、nodejs 更新

npm install -g n
n latest

2、npm更新

npm update

ETCD

1、etcd 删除
指定api版本

export ETCDCTL_API=3

查询所有的key

etcdctl get / --prefix --keys-only

查找要删除的key

etcdctl get / --prefix --keys-only |grep 备品备件

按照key删除

etcdctl del /cmdb/hsirrfw/apps/备品备件

Golang

1、go mod获取最新commit

go get github.com/jiankunking-interx/osin@75f6b6f1f2f8ad9472c1a209e91625bef7f57cc3

2、自定义package 获取

Windows走goproxy的时候获取包会失败，可以针对这个包关闭下
PowerShell (Windows)
$env:GOPRIVATE = "git.jiankunking.net,github.com/jiankunking-interx/gogin"

go get -u github.com/jiankunking-interx/gogin@v1.0.0

PostgreSQL

1、PG统计所有表的基本信息(如行数、大小等)

SELECT
  relname AS TABLE_NAME,
  reltuples AS rowCounts
FROM
  pg_class
WHERE
  relkind = 'r'
AND relnamespace = (
  SELECT
    oid
  FROM
    pg_namespace
  WHERE
    nspname = 'public'
)
ORDER BY
  rowCounts DESC;