Vi/Vim
1、 粘贴时行首出现很多缩进和空格
在拷贝前输入:set paste (这样的话,vim就不会启动自动缩进,而只是纯拷贝粘贴)
vi 打开文件后,直接输入:set paste,然后再按i
2、 通过vi删除空行
//dd 删除当前行。
先按esc退出编辑模式,再dd即可
3、 vi 换行
进入非编辑模式,字母o
4、Vim用快捷键快速移动光标至行尾
1)按end键
2)按住shift + 4
Docker
1、 获取完整id
docker inspect -f '{{.Id}}' d8e703d7e303
2、 退出并不关闭容器
ctrl + p 再 ctrl+q
3、 推送镜像到私服
sudo docker push hub.docker.jiankunking.io:5000/jetty:jetty8
//冒号前后不要有空格
4、 docker build
docker build -t runoob/ubuntu:v1 .
docker build -t jiankunking/kafka:0.8.2.2 -f kafka.Dockerfile .
5、docker add
ADD还支持自动解压tar文件,比如ADD trusty-core-amd64.tar.gz /会线自动解压内容再COPY到在容器的/目录下。
6、删除名称或标签为none的镜像
docker rmi -f `docker images | grep '<none>' | awk '{print $3}'`
7、容器删除删除所有未运行的容器(已经运行的删除不了,未运行的就一起被删除了)
sudo docker rm $(sudo docker ps -a -q)
删除没有被使用的镜像
docker rmi $(docker images -q)
8、docker var目录占用高问题
如果是/var/lib/docker/devicemapper/mnt占用率高
那就找出占用最高的文件
du -sh /var/lib/docker/devicemapper/mnt/*
此时的文件名称是DeviceName
然后
docker ps | awk '{print "docker inspect "$1}'|grep -v CONTAINER|sh > ./inspect.log
docker ps | awk '{print "docker inspect "$1}'|grep -v CONTAINER|sh > ./inspect.log
进入inspect查看docker信息 找到对应的正在运行的docker id
9、更新docker 重启策略
docker update --restart=always 11756183ff8a
https://docs.docker.com/engine/reference/commandline/update/
10、更新容器的内存限制
# --memory-swap -1 表示不限制
# -memory-swap 内存+交换分区大小总限制。格式同上。必须比-m设置的大
docker update -m 1024m --memory-swap -1 fea22ac3fdd7
11、容器内CPU、内存限制在/sys/fs/cgroup下
12、docker 查看容器的网络连接
#! /bin/bash
echo $1
PID=$(docker inspect -f '{{.State.Pid}}' $1)
nsenter -t $PID -n netstat |grep ESTABLISHED
sudo sh docker-netstat.sh demo
第一步可以用docker top 找到pid
13、当 OOM 发生时,系统会把相关的 OOM 信息,记录到日志中。所以,我们可以在终端中执行 dmesg 命令,查看系统日志,并定位 OOM 相关的日志。(即使docker容器OOM后,也可以查看)
14、docker的/var/lib/docker目录迁移
1 停止docker服务
systemctl stop docker
2 创建新的docker目录
mkdir -p /data/docker/lib
3 迁移/var/lib/docker
rsync -avzH /var/lib/docker /data/docker/lib/
4 修改配置路径
ln -s /data/docker/lib /var/lib/docker
5 重新加载 docker
systemctl daemon-reload
systemctl restart docker
systemctl enable docker
6 删除 /var/lib/docker
rm -rf /var/lib/docker
15、通过docker overlay2 目录名查找对应容器名
有时候经常会有个别容器占用磁盘空间特别大,这个时候就需要通过docker overlay2 目录名查找对应容器名:
首先进入到 /var/lib/docker/overlay2 目录下,查看谁占用的较多
如图所示,占用空间最大的目录为6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35
再通过目录名查找容器名
docker ps -q | xargs docker inspect --format '{{.State.Pid}}, {{.Id}}, {{.Name}}, {{.GraphDriver.Data.WorkDir}}' | grep 6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35
-- 输出依次为,进程pid、容器ID、容器名、存储work路径,即可确定是哪个容器
18748, a43a3a22b0293fc001a7b325d18ed76af207f838959bbd405d792e96eafae294, /console_jumpserver_1567680881201, /var/lib/docker/overlay/6f837b173d76c624853f553d752d2072161f0dbe3afeccf093e7088ff7d05e35/work
containerd
1、从宿主机拷贝文件到containerd
// 1、通过找到进程id
// 2、在宿主机从进入containerd所在目录
// 3、该目录就是containerd中的根目录/
cd /proc/<PID>/root
Idea
1、 idea 类中函数全部折叠
ctrl + shift + 减号
2、 idea 类中函数全部展开
ctrl + shift + 加号
3、 idea 回到调用方法
ctrl + alt + f7
4、查找接口的实现类
ctrl + alt +B
5、查看类或接口的继承关系
ctrl + h
6、查看一个方法的调用
Ctrl + Alt + H
7、重复代码快速重构(抽取重复代码)
Alt+Shift+M
Kafka
1、 查看kafka主题数据
bin/kafka-topics.sh --zookeeper 10.138.22.194:2181 --describe --topic count_test_one
2、 手动调用消费端
./kafka-console-consumer.sh --zookeeper localhost:2181 --topic count_test_one --from-beginning
./kafka-console-consumer.sh --zookeeper localhost:2181 --topic count_test_one
./kafka-console-consumer.sh --bootstrap-server 10.119.37.115:9092,10.119.37.147:9092,10.119.37.148:9092 --topic dubbo |grep xiaoneng
// 2.0
bin/kafka-console-consumer.sh --bootstrap-server 10.163.111.195:9092 --topic qd-aliyun --from-beginning
3、kafka启动
bin/kafka-server-start.sh -daemon config/server.properties
4、kafka 消费端启动
java -jar monitor-kafka-consumer-0.0.1-SNAPSHOT.jar -Dtopic=custom
5、查看kafka所有topic
bin/kafka-topics.sh --list --zookeeper localhost:2181
bin/kafka-topics.sh --bootstrap-server 127.0.0.1:9092 --list
6、kafka消费端 消费指定主题
./kafka-console-consumer.sh --zookeeper localhost:2181 --topic xiaonengdubbo2
// 2.x
./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mysql-prod.console.org --partition 1
7、获取kafka中所有组
./kafka-consumer-groups.sh --bootstrap-server 127.0.0.1:9092 --list
8、查看kafka消费端堆积量
./kafka-consumer-groups.sh --bootstrap-server 127.0.0.1:9092 --group interconn --describe
9、查看kafka版本
find ./libs/ -name 'kafka_*.jar.asc' |head -n1 | cut -d'/' -f3
10、查看kafka某个topic下partition信息
./kafka-topics.sh --zookeeper 10.138.1.1:2181 --topic dubbo --describe
11、修改partition数量
./kafka-topics.sh --alter --zookeeper 10.230.204.83:2181,10.230.204.84:2181,10.230.204.85:2181 --topic cdc --partitions 6
12、修改副本数
配置文件:
83 84 85是kafka broker id
{
"version": 1,
"partitions": [
{
"topic": "cdc",
"partition": 0,
"replicas": [
83,
84
]
},
{
"topic": "cdc",
"partition": 1,
"replicas": [
84,
85
]
},
{
"topic": "cdc",
"partition": 2,
"replicas": [
83,
85
]
},
{
"topic": "cdc",
"partition": 3,
"replicas": [
84,
85
]
},
{
"topic": "cdc",
"partition": 4,
"replicas": [
83,
84
]
},
{
"topic": "cdc",
"partition": 5,
"replicas": [
83,
85
]
}
]
}
执行脚本:
./kafka-reassign-partitions.sh --zookeeper 10.230.204.83:2181,10.230.204.84:2181,10.230.204.85:2181 --reassignment-json-file reassignment.json --execute
Git
1、 git忽略文件命令
git update-index --assume-unchanged FILE 在FILE处输入要忽略的文件。
2、git rebase
# 引起冲突的commits会被丢弃,因此,在使用skip时请慎重。
git rebase --skip
# 可以运行git rebase –continue继续直到完成
git rebase --continue
3、git reflog
显示整个本地仓储的commit, 包括所有branch的commit, 甚至包括已经撤销的commit, 只要HEAD发生了变化, 就会在reflog里面看得到. git log只包括当前分支的commit.
4、git log --graph
–graph 参数会根据分枝提交历史绘出图像。这个命令通常和–oneline,–decorate一起使用
git log --graph --oneline --decorate
5、git log
可以使用–pretty=format:""来自定义输出的格式。输出格式有点像printf中的占位符。
举个例子,下面的命令中,%cn,%h和%cd会被提交者姓名,commit的hash缩写,提交的日期占据
git log --pretty=format:"%cn committed %h on %cd"
格式化参考
https://www.kernel.org/pub/software/scm/git/docs/git-log.html#_pretty_formats
6、git fetch
git fetch命令用于从另一个存储库下载对象和引用。
7、丢弃工作区的修改
命令git checkout – readme.txt意思就是,把readme.txt文件在工作区的修改全部撤销,这里有两种情况:
一种是readme.txt自修改后还没有被放到暂存区,现在,撤销修改就回到和版本库一模一样的状态;
一种是readme.txt已经添加到暂存区后,又作了修改,现在,撤销修改就回到添加到暂存区后的状态。
总之,就是让这个文件回到最近一次git commit或git add时的状态。
8、采用主分支上的/response.go文件
git checkout c4a651ba96d25a15adbecb21025f0d1d60901b6a pkg/models/response.go
9、终止git log 命令
按 q ,然后回车, 即可退出
Maven
1、打包时跳过测试
mvn clean package -Dmaven.test.skip=true
Zookeeper
1、zookeeper 节点 命令查看
./zkCli.sh -timeout 5000 -r -server localhost:2181
2、查看zk集群状态
echo mntr | nc localhost 2181
leader节点返回示例:
Zookeeper version: 3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
Clients:
/127.0.0.1:39436[1](queued=0,recved=493,sent=493)
/127.0.0.1:39526[1](queued=0,recved=479,sent=479)
/127.0.0.1:39510[1](queued=0,recved=507,sent=507)
/127.0.0.1:39410[1](queued=0,recved=459,sent=459)
/127.0.0.1:39424[1](queued=0,recved=517,sent=517)
/0:0:0:0:0:0:0:1:41446[0](queued=0,recved=1,sent=0)
/127.0.0.1:39416[1](queued=0,recved=494,sent=494)
/127.0.0.1:39404[1](queued=0,recved=491,sent=491)
/127.0.0.1:39514[1](queued=0,recved=486,sent=486)
/127.0.0.1:39496[1](queued=0,recved=490,sent=490)
Latency min/avg/max: 0/0/12
Received: 4770
Sent: 4453
Connections: 10
Outstanding: 0
Zxid: 0x5000000f4
Mode: leader
Node count: 313
Proposal sizes last/min/max: 36/32/36
You have mail in /var/spool/mail/root
follower节点返回:
zk_version 3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
zk_avg_latency 0
zk_max_latency 12
zk_min_latency 0
zk_packets_received 190
zk_packets_sent 189
zk_num_alive_connections 7
zk_outstanding_requests 0
zk_server_state follower
zk_znode_count 313
zk_watch_count 2
zk_ephemerals_count 4
zk_approximate_data_size 25605
zk_open_file_descriptor_count 106
zk_max_file_descriptor_count 65536
如果提示:mntr is not executed because it is not in the whitelist.
解决办法,修改 conf/zoo.cfg 添加以下属性
#开启四字命令
4lw.commands.whitelist=*
Nginx
1、nginx启动(nginx安装目录地址 -c nginx配置文件地址)
/usr/local/nginx/sbin/nginx -c /usr/local/nginx/conf/nginx.conf
2、查看nginx配置文件
nginx -t
3、nginx 重启
查找当前nginx进程号,然后输入命令:kill -HUP 进程号 实现重启nginx服务
MySQL
1、查看mysql表分区
SELECT
partition_name part,
partition_expression expr,
partition_description descr,
table_rows
FROM
information_schema. PARTITIONS
WHERE
table_schema = SCHEMA ()
AND table_name = 'application_hour_count';
2、mysql 外键
禁用外键约束:
SET FOREIGN_KEY_CHECKS=0;
启动外键约束:
SET FOREIGN_KEY_CHECKS=1;
3、Mysql统计所有表数据量
SELECT
TABLE_NAME,
TABLE_ROWS
FROM
`information_schema`.`tables`
WHERE
`table_schema` = 'YOUR_DB_NAME'
ORDER BY
TABLE_ROWS DESC;
4、MySQL查询表中重复字段和重复的次数
SELECT
user_name,
count(*) AS count
FROM
USER
GROUP BY
user_name
HAVING
count > 1
ORDER BY
count DESC;
5、查看mysql的配置变量
show VARIABLES
具体结果
auto_increment_increment 1
auto_increment_offset 1
autocommit ON
automatic_sp_privileges OFF
avoid_temporal_upgrade OFF
back_log 512
basedir /usr/local/mysql/
big_tables OFF
bind_address *
binlog_cache_size 32768
binlog_checksum CRC32
binlog_direct_non_transactional_updates OFF
binlog_error_action ABORT_SERVER
binlog_format ROW
binlog_group_commit_sync_delay 0
binlog_group_commit_sync_no_delay_count 0
binlog_gtid_simple_recovery ON
binlog_max_flush_queue_time 0
binlog_order_commits ON
binlog_row_image FULL
binlog_rows_query_log_events ON
binlog_stmt_cache_size 32768
binlog_transaction_dependency_history_size 25000
binlog_transaction_dependency_tracking COMMIT_ORDER
block_encryption_mode aes-128-ecb
bulk_insert_buffer_size 8388608
character_set_client utf8mb4
character_set_connection utf8mb4
character_set_database utf8
character_set_filesystem binary
character_set_results utf8mb4
character_set_server utf8
character_set_system utf8
character_sets_dir /usr/local/mysql/share/charsets/
check_proxy_users OFF
collation_connection utf8mb4_general_ci
collation_database utf8_general_ci
collation_server utf8_general_ci
completion_type NO_CHAIN
concurrent_insert AUTO
connect_timeout 10
core_file OFF
datadir /data/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
default_authentication_plugin mysql_native_password
default_password_lifetime 0
default_storage_engine InnoDB
default_tmp_storage_engine InnoDB
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
disabled_storage_engines
disconnect_on_expired_password ON
div_precision_increment 4
end_markers_in_json OFF
enforce_gtid_consistency OFF
eq_range_index_dive_limit 200
error_count 0
event_scheduler OFF
expire_logs_days 7
explicit_defaults_for_timestamp ON
external_user
flush OFF
flush_time 0
foreign_key_checks ON
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
general_log OFF
general_log_file /data/mysql/cmp24.log
group_concat_max_len 10240
gtid_executed_compression_period 1000
gtid_mode OFF
gtid_next AUTOMATIC
gtid_owned
gtid_purged
have_compress YES
have_crypt YES
have_dynamic_loading YES
have_geometry YES
have_openssl DISABLED
have_profiling YES
have_query_cache YES
have_rtree_keys YES
have_ssl DISABLED
have_statement_timeout YES
have_symlink YES
host_cache_size 753
hostname cmp24
identity 0
ignore_builtin_innodb OFF
ignore_db_dirs
init_connect
init_file
init_slave
innodb_adaptive_flushing ON
innodb_adaptive_flushing_lwm 10
innodb_adaptive_hash_index ON
innodb_adaptive_hash_index_parts 8
innodb_adaptive_max_sleep_delay 150000
innodb_api_bk_commit_interval 5
innodb_api_disable_rowlock OFF
innodb_api_enable_binlog OFF
innodb_api_enable_mdl OFF
innodb_api_trx_level 0
innodb_autoextend_increment 64
innodb_autoinc_lock_mode 1
innodb_buffer_pool_chunk_size 134217728
innodb_buffer_pool_dump_at_shutdown ON
innodb_buffer_pool_dump_now OFF
innodb_buffer_pool_dump_pct 25
innodb_buffer_pool_filename ib_buffer_pool
innodb_buffer_pool_instances 8
innodb_buffer_pool_load_abort OFF
innodb_buffer_pool_load_at_startup ON
innodb_buffer_pool_load_now OFF
innodb_buffer_pool_size 10737418240
innodb_change_buffer_max_size 25
innodb_change_buffering all
innodb_checksum_algorithm crc32
innodb_checksums ON
innodb_cmp_per_index_enabled OFF
innodb_commit_concurrency 0
innodb_compression_failure_threshold_pct 5
innodb_compression_level 6
innodb_compression_pad_pct_max 50
innodb_concurrency_tickets 5000
innodb_data_file_path ibdata1:12M:autoextend
innodb_data_home_dir /data/mysql
innodb_deadlock_detect ON
innodb_default_row_format dynamic
innodb_disable_sort_file_cache OFF
innodb_doublewrite ON
innodb_fast_shutdown 1
innodb_file_format Barracuda
innodb_file_format_check ON
innodb_file_format_max Barracuda
innodb_file_per_table ON
innodb_fill_factor 100
innodb_flush_log_at_timeout 1
innodb_flush_log_at_trx_commit 1
innodb_flush_method
innodb_flush_neighbors 1
innodb_flush_sync ON
innodb_flushing_avg_loops 30
innodb_force_load_corrupted OFF
innodb_force_recovery 0
innodb_ft_aux_table
innodb_ft_cache_size 8000000
innodb_ft_enable_diag_print OFF
innodb_ft_enable_stopword ON
innodb_ft_max_token_size 84
innodb_ft_min_token_size 3
innodb_ft_num_word_optimize 2000
innodb_ft_result_cache_limit 2000000000
innodb_ft_server_stopword_table
innodb_ft_sort_pll_degree 2
innodb_ft_total_cache_size 640000000
innodb_ft_user_stopword_table
innodb_io_capacity 200
innodb_io_capacity_max 2000
innodb_large_prefix ON
innodb_lock_wait_timeout 3600
innodb_locks_unsafe_for_binlog OFF
innodb_log_buffer_size 16777216
innodb_log_checksums ON
innodb_log_compressed_pages ON
innodb_log_file_size 1073741824
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_log_write_ahead_size 8192
innodb_lru_scan_depth 1024
innodb_max_dirty_pages_pct 75.000000
innodb_max_dirty_pages_pct_lwm 0.000000
innodb_max_purge_lag 0
innodb_max_purge_lag_delay 0
innodb_max_undo_log_size 1073741824
innodb_monitor_disable
innodb_monitor_enable
innodb_monitor_reset
innodb_monitor_reset_all
innodb_numa_interleave OFF
innodb_old_blocks_pct 37
innodb_old_blocks_time 1000
innodb_online_alter_log_max_size 134217728
innodb_open_files 1024
innodb_optimize_fulltext_only OFF
innodb_page_cleaners 4
innodb_page_size 16384
innodb_print_all_deadlocks OFF
innodb_purge_batch_size 300
innodb_purge_rseg_truncate_frequency 128
innodb_purge_threads 4
innodb_random_read_ahead OFF
innodb_read_ahead_threshold 56
innodb_read_io_threads 4
innodb_read_only OFF
innodb_replication_delay 0
innodb_rollback_on_timeout OFF
innodb_rollback_segments 128
innodb_sort_buffer_size 1048576
innodb_spin_wait_delay 6
innodb_stats_auto_recalc ON
innodb_stats_include_delete_marked OFF
innodb_stats_method nulls_equal
innodb_stats_on_metadata OFF
innodb_stats_persistent ON
innodb_stats_persistent_sample_pages 20
innodb_stats_sample_pages 8
innodb_stats_transient_sample_pages 8
innodb_status_output OFF
innodb_status_output_locks OFF
innodb_strict_mode ON
innodb_support_xa ON
innodb_sync_array_size 1
innodb_sync_spin_loops 30
innodb_table_locks ON
innodb_temp_data_file_path ibtmp1:12M:autoextend
innodb_thread_concurrency 0
innodb_thread_sleep_delay 10000
innodb_tmpdir
innodb_undo_directory ./
innodb_undo_log_truncate OFF
innodb_undo_logs 128
innodb_undo_tablespaces 0
innodb_use_native_aio ON
innodb_version 5.7.23
innodb_write_io_threads 4
insert_id 0
interactive_timeout 600
internal_tmp_disk_storage_engine InnoDB
join_buffer_size 4194304
keep_files_on_create OFF
key_buffer_size 8388608
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
keyring_operations ON
large_files_support ON
large_page_size 0
large_pages OFF
last_insert_id 0
lc_messages en_US
lc_messages_dir /usr/local/mysql/share/
lc_time_names en_US
license GPL
local_infile ON
lock_wait_timeout 31536000
locked_in_memory OFF
log_bin ON
log_bin_basename /data/mysql/mysql-binlog
log_bin_index /data/mysql/mysql-binlog.index
log_bin_trust_function_creators ON
log_bin_use_v1_row_events OFF
log_builtin_as_identified_by_password OFF
log_error /data/mysql/error.log
log_error_verbosity 3
log_output FILE
log_queries_not_using_indexes OFF
log_slave_updates ON
log_slow_admin_statements OFF
log_slow_slave_statements OFF
log_statements_unsafe_for_binlog ON
log_syslog OFF
log_syslog_facility daemon
log_syslog_include_pid ON
log_syslog_tag
log_throttle_queries_not_using_indexes 0
log_timestamps SYSTEM
log_warnings 2
long_query_time 1.000000
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 1
master_info_repository FILE
master_verify_checksum OFF
max_allowed_packet 67108864
max_binlog_cache_size 18446744073709547520
max_binlog_size 1073741824
max_binlog_stmt_cache_size 18446744073709547520
max_connect_errors 200000
max_connections 3000
max_delayed_threads 20
max_digest_length 1024
max_error_count 64
max_execution_time 0
max_heap_table_size 33554432
max_insert_delayed_threads 20
max_join_size 18446744073709551615
max_length_for_sort_data 1024
max_points_in_geometry 65536
max_prepared_stmt_count 16382
max_relay_log_size 0
max_seeks_for_key 18446744073709551615
max_sort_length 1024
max_sp_recursion_depth 0
max_tmp_tables 32
max_user_connections 0
max_write_lock_count 18446744073709551615
metadata_locks_cache_size 1024
metadata_locks_hash_instances 8
min_examined_row_limit 0
multi_range_count 256
myisam_data_pointer_size 6
myisam_max_sort_file_size 9223372036853727232
myisam_mmap_size 18446744073709551615
myisam_recover_options OFF
myisam_repair_threads 1
myisam_sort_buffer_size 8388608
myisam_stats_method nulls_unequal
myisam_use_mmap OFF
mysql_native_password_proxy_users OFF
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 60
new OFF
ngram_token_size 2
offline_mode OFF
old OFF
old_alter_table OFF
old_passwords 0
open_files_limit 65535
optimizer_prune_level 1
optimizer_search_depth 62
optimizer_switch index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,engine_condition_pushdown=on,index_condition_pushdown=on,mrr=on,mrr_cost_based=on,block_nested_loop=on,batched_key_access=off,materialization=on,semijoin=on,loosescan=on,firstmatch=on,duplicateweedout=on,subquery_materialization_cost_based=on,use_index_extensions=on,condition_fanout_filter=on,derived_merge=on
optimizer_trace enabled=off,one_line=off
optimizer_trace_features greedy_search=on,range_optimizer=on,dynamic_range=on,repeated_subselect=on
optimizer_trace_limit 1
optimizer_trace_max_mem_size 16384
optimizer_trace_offset -1
parser_max_mem_size 18446744073709551615
performance_schema ON
performance_schema_accounts_size -1
performance_schema_digests_size 10000
performance_schema_events_stages_history_long_size 10000
performance_schema_events_stages_history_size 10
performance_schema_events_statements_history_long_size 10000
performance_schema_events_statements_history_size 10
performance_schema_events_transactions_history_long_size 10000
performance_schema_events_transactions_history_size 10
performance_schema_events_waits_history_long_size 10000
performance_schema_events_waits_history_size 10
performance_schema_hosts_size -1
performance_schema_max_cond_classes 80
performance_schema_max_cond_instances -1
performance_schema_max_digest_length 1024
performance_schema_max_file_classes 80
performance_schema_max_file_handles 32768
performance_schema_max_file_instances -1
performance_schema_max_index_stat -1
performance_schema_max_memory_classes 320
performance_schema_max_metadata_locks -1
performance_schema_max_mutex_classes 210
performance_schema_max_mutex_instances -1
performance_schema_max_prepared_statements_instances -1
performance_schema_max_program_instances -1
performance_schema_max_rwlock_classes 40
performance_schema_max_rwlock_instances -1
performance_schema_max_socket_classes 10
performance_schema_max_socket_instances -1
performance_schema_max_sql_text_length 1024
performance_schema_max_stage_classes 150
performance_schema_max_statement_classes 193
performance_schema_max_statement_stack 10
performance_schema_max_table_handles -1
performance_schema_max_table_instances -1
performance_schema_max_table_lock_stat -1
performance_schema_max_thread_classes 50
performance_schema_max_thread_instances -1
performance_schema_session_connect_attrs_size 512
performance_schema_setup_actors_size -1
performance_schema_setup_objects_size -1
performance_schema_users_size -1
pid_file /data/mysql/mysql.pid
plugin_dir /usr/local/mysql/lib/plugin/
port 3306
preload_buffer_size 32768
profiling ON
profiling_history_size 15
protocol_version 10
proxy_user
pseudo_slave_mode OFF
pseudo_thread_id 42389158
query_alloc_block_size 8192
query_cache_limit 1048576
query_cache_min_res_unit 4096
query_cache_size 0
query_cache_type OFF
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
rand_seed1 0
rand_seed2 0
range_alloc_block_size 4096
range_optimizer_max_mem_size 8388608
rbr_exec_mode STRICT
read_buffer_size 131072
read_only OFF
read_rnd_buffer_size 262144
relay_log
relay_log_basename /data/mysql/cmp24-relay-bin
relay_log_index /data/mysql/cmp24-relay-bin.index
relay_log_info_file relay-log.info
relay_log_info_repository FILE
relay_log_purge ON
relay_log_recovery OFF
relay_log_space_limit 0
report_host
report_password
report_port 3306
report_user
require_secure_transport OFF
rpl_stop_slave_timeout 31536000
secure_auth ON
secure_file_priv NULL
server_id 3306100
server_id_bits 32
server_uuid 7b607ec8-2525-11e9-86f1-52f6795368e8
session_track_gtids OFF
session_track_schema ON
session_track_state_change OFF
session_track_system_variables time_zone,autocommit,character_set_client,character_set_results,character_set_connection
session_track_transaction_info OFF
sha256_password_proxy_users OFF
show_compatibility_56 OFF
show_create_table_verbosity OFF
show_old_temporals OFF
skip_external_locking ON
skip_name_resolve OFF
skip_networking OFF
skip_show_database OFF
slave_allow_batching OFF
slave_checkpoint_group 512
slave_checkpoint_period 300
slave_compressed_protocol OFF
slave_exec_mode STRICT
slave_load_tmpdir /tmp
slave_max_allowed_packet 1073741824
slave_net_timeout 60
slave_parallel_type DATABASE
slave_parallel_workers 0
slave_pending_jobs_size_max 16777216
slave_preserve_commit_order OFF
slave_rows_search_algorithms TABLE_SCAN,INDEX_SCAN
slave_skip_errors OFF
slave_sql_verify_checksum ON
slave_transaction_retries 10
slave_type_conversions
slow_launch_time 2
slow_query_log ON
slow_query_log_file /data/mysql/slow_query.log
socket /data/mysql/mysql.sock
sort_buffer_size 4194304
sql_auto_is_null OFF
sql_big_selects ON
sql_buffer_result OFF
sql_log_bin ON
sql_log_off OFF
sql_mode STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
sql_notes ON
sql_quote_show_create ON
sql_safe_updates OFF
sql_select_limit 18446744073709551615
sql_slave_skip_counter 0
sql_warnings OFF
ssl_ca
ssl_capath
ssl_cert
ssl_cipher
ssl_crl
ssl_crlpath
ssl_key
stored_program_cache 256
super_read_only OFF
sync_binlog 0
sync_frm ON
sync_master_info 10000
sync_relay_log 10000
sync_relay_log_info 10000
system_time_zone CST
table_definition_cache 912
table_open_cache 1024
table_open_cache_instances 16
thread_cache_size 512
thread_handling one-thread-per-connection
thread_stack 262144
time_format %H:%i:%s
time_zone SYSTEM
timestamp 1647388592.535236
tls_version TLSv1,TLSv1.1
tmp_table_size 33554432
tmpdir /tmp
transaction_alloc_block_size 8192
transaction_allow_batching OFF
transaction_isolation READ-COMMITTED
transaction_prealloc_size 4096
transaction_read_only OFF
transaction_write_set_extraction OFF
tx_isolation READ-COMMITTED
tx_read_only OFF
unique_checks ON
updatable_views_with_limit YES
version 5.7.23-log
version_comment MySQL Community Server (GPL)
version_compile_machine x86_64
version_compile_os el7
wait_timeout 600
warning_count 0
6、哪些事务正在等待,哪些事务正在阻塞:
// 5.7 方式一
SELECT
r.trx_id waiting_trx_id,
r.trx_mysql_thread_id waiting_thread,
r.trx_query waiting_query,
b.trx_id blocking_trx_id,
b.trx_mysql_thread_id blocking_thread,
b.trx_query blocking_query
FROM information_schema.innodb_lock_waits w
INNER JOIN information_schema.innodb_trx b
ON b.trx_id = w.blocking_trx_id
INNER JOIN information_schema.innodb_trx r
ON r.trx_id = w.requesting_trx_id;
// 5.7 方式二(普通账号不一定有权限)
SELECT
waiting_trx_id,
waiting_pid,
waiting_query,
blocking_trx_id,
blocking_pid,
blocking_query
FROM sys.innodb_lock_waits;
// 8.X 方式一
SELECT
r.trx_id waiting_trx_id,
r.trx_mysql_thread_id waiting_thread,
r.trx_query waiting_query,
b.trx_id blocking_trx_id,
b.trx_mysql_thread_id blocking_thread,
b.trx_query blocking_query
FROM performance_schema.data_lock_waits w
INNER JOIN information_schema.innodb_trx b
ON b.trx_id = w.blocking_engine_transaction_id
INNER JOIN information_schema.innodb_trx r
ON r.trx_id = w.requesting_engine_transaction_id;
// 8.x 方式二(普通账号不一定有权限)
SELECT
waiting_trx_id,
waiting_pid,
waiting_query,
blocking_trx_id,
blocking_pid,
blocking_query
FROM sys.innodb_lock_waits;
整理自:
- https://dev.mysql.com/doc/refman/8.0/en/innodb-information-schema-examples.html
- https://dev.mysql.com/doc/refman/5.7/en/innodb-information-schema-examples.html
7、How to select static values column?=> 如何将固定值转成列(这里主要是为了当做临时表)
SELECT 1 as Value
UNION
SELECT 2 as Value
UNION
SELECT 3 as Value
8、
MongoDB
1、登陆MongoDB
sudo ssh jiankunking@10.138.40.221
sudo docker ps
sudo docker exec -it 83aa14b64901 /bin/bash
mongo
2、基础查询
rs0:PRIMARY> show dbs
admin 0.000GB
console-web 0.452GB
rs0:PRIMARY> use console-web
switched to db console-web
rs0:PRIMARY> show collections
clusters
fileuploads
rs0:PRIMARY>
rs0:PRIMARY>
rs0:PRIMARY> db.clusters.find().pretty()
Elasticsearch
Prometheus
1、重新加载文件
curl -XPOST http://127.0.0.1:9090/-/reload
Kibana
1、kibana启动
nohup ./bin/kibana >/dev/null &
bin/kibana-plugin install file:///usr/local/x-pack-5.6.9.zip
2、kibana查看非空字段
_exists_:labels
Consul
1、查询当前集群下拥有的datacenter信息
consul members -wan
Node.js
1、nodejs 更新
npm install -g n
n latest
2、npm更新
npm update
ETCD
1、etcd 删除
指定api版本
export ETCDCTL_API=3
查询所有的key
etcdctl get / --prefix --keys-only
查找要删除的key
etcdctl get / --prefix --keys-only |grep 备品备件
按照key删除
etcdctl del /cmdb/hsirrfw/apps/备品备件
Golang
1、go mod获取最新commit
go get github.com/jiankunking-interx/osin@75f6b6f1f2f8ad9472c1a209e91625bef7f57cc3
2、自定义package 获取
Windows走goproxy的时候获取包会失败,可以针对这个包关闭下
PowerShell (Windows)
$env:GOPRIVATE = "git.jiankunking.net,github.com/jiankunking-interx/gogin"
go get -u github.com/jiankunking-interx/gogin@v1.0.0
PostgreSQL
1、PG统计所有表的基本信息(如行数、大小等)
SELECT
relname AS TABLE_NAME,
reltuples AS rowCounts
FROM
pg_class
WHERE
relkind = 'r'
AND relnamespace = (
SELECT
oid
FROM
pg_namespace
WHERE
nspname = 'public'
)
ORDER BY
rowCounts DESC;