Memcached
免费和开源,高性能,分布式内存对象缓存系统,本质上是通用的,但旨在通过减轻数据库负载来加速动态Web应用程序。
Memcached 是一个内存中的键值存储,用于存储来自数据库调用、API 调用或页面结果的小块任意数据(字符串、对象) 渲染。
Memcached简单而强大。其简单的设计促进了快速部署,易于开发,并解决了大数据缓存面临的许多问题。它的 API 可用于大多数流行语言。
memcached 是一种高性能的分布式内存对象缓存 系统,本质上是通用的,但最初用于超速 通过减轻数据库负载来提升动态 Web 应用程序。
可以将其视为应用程序的短期缓存。
memcached 允许从系统的某些部分获取内存,其中拥有的比需要的更多,并使其可以访问以下区域 拥有的比你需要的少。
memcached 还允许更好地利用内存。如果你考虑下边的示意图,可以看到两个部署场景:
每个节点都是完全独立的(顶部)。
每个节点都可以利用来自其他节点的内存(底部)。
第一个方案说明了经典部署策略,但是,你会发现这既浪费又浪费了 总缓存大小只是 Web 实际容量的一小部分农场,还要在保持所需的努力量上缓存在所有这些节点上保持一致。
使用memcached,您可以看到所有服务器都在查看相同的虚拟内存池。这意味着给定的项目是始终存储并始终从您的同一位置检索整个 Web 群集。
此外,随着对应用程序需求的增长 到您需要拥有更多服务器的程度,通常也 在必须定期访问的数据方面增长。一个 系统这两个方面扩展的部署策略 在一起是有道理的。
右图仅显示了两个 Web 服务器 简单,但属性与数字相同 增加。如果你有五十个 Web 服务器,你仍然有一个可用的 在第一个示例中,缓存大小为 64MB,但在第二个示例中,您将 有3.2GB的可用缓存。
当然,您不需要将Web服务器的内存用于 缓存。许多memcached用户拥有构建的专用机器 仅是内存缓存服务器。
官网
http:
//memcached.org/downloads
理解
Memcached 在内存中以键值(key => value) 形式进行存储数据。数据类型包括,字符串和对象。其数据无法持久化,存储于内存当中,断电即失。存储不重要的细碎数据,如做session共享。其key最大为250字节,value最大为1MB,默认端口号 11211
memcached --help
ophelia@Ophelia:~$ memcached --help
memcached 1.6.14
-p, --port=<num> TCP port to listen on (default: 11211)
-U, --udp-port=<num> UDP port to listen on (default: 0, off)
-s, --unix-socket=<file> UNIX socket to listen on (disables network support)
-a, --unix-mask=<mask> access mask for UNIX socket, in octal (default: 700)
-A, --enable-shutdown enable ascii "shutdown" command
-l, --listen=<addr> interface to listen on (default: INADDR_ANY)
if TLS/SSL is enabled, 'notls' prefix can be used to
disable for specific listeners (-l notls:<ip>:<port>)
-d, --daemon run as a daemon
-r, --enable-coredumps maximize core file limit
-u, --user=<user> assume identity of <username> (only when run as root)
-m, --memory-limit=<num> item memory in megabytes (default: 64)
-M, --disable-evictions return error on memory exhausted instead of evicting
-c, --conn-limit=<num> max simultaneous connections (default: 1024)
-k, --lock-memory lock down all paged memory
-v, --verbose verbose (print errors/warnings while in event loop)
-vv very verbose (also print client commands/responses)
-vvv extremely verbose (internal state transitions)
-h, --help print this help and exit
-i, --license print memcached and libevent license
-V, --version print version and exit
-P, --pidfile=<file> save PID in <file>, only used with -d option
-f, --slab-growth-factor=<num> chunk size growth factor (default: 1.25)
-n, --slab-min-size=<bytes> min space used for key+value+flags (default: 48)
-L, --enable-largepages try to use large memory pages (if available)
-D <char> Use <char> as the delimiter between key prefixes and IDs.
This is used for per-prefix stats reporting. The default is
":" (colon). If this option is specified, stats collection
is turned on automatically; if not, then it may be turned on
by sending the "stats detail on" command to the server.
-t, --threads=<num> number of threads to use (default: 4)
-R, --max-reqs-per-event maximum number of requests per event, limits the
requests processed per connection to prevent
starvation (default: 20)
-C, --disable-cas disable use of CAS
-b, --listen-backlog=<num> set the backlog queue limit (default: 1024)
-B, --protocol=<name> protocol - one of ascii, binary, or auto (default: auto-negotiate)
-I, --max-item-size=<num> adjusts max item size
(default: 1m, min: 1k, max: 1024m)
-S, --enable-sasl turn on Sasl authentication
-F, --disable-flush-all disable flush_all command
-X, --disable-dumping disable stats cachedump and lru_crawler metadump
-W --disable-watch disable watch commands (live logging)
-Y, --auth-file=<file> (EXPERIMENTAL) enable ASCII protocol authentication. format:
user:pass\nuser2:pass2\n
-e, --memory-file=<file> (EXPERIMENTAL) mmap a file for item memory.
use only in ram disks or persistent memory mounts!
enables restartable cache (stop with SIGUSR1)
-Z, --enable-ssl enable TLS/SSL
-o, --extended comma separated list of extended options
most options have a 'no_' prefix to disable
- maxconns_fast: immediately close new connections after limit (default: enabled)
- hashpower: an integer multiplier for how large the hash
table should be. normally grows at runtime. (default starts at: 0)
set based on "STAT hash_power_level"
- tail_repair_time: time in seconds for how long to wait before
forcefully killing LRU tail item.
disabled by default; very dangerous option.
- hash_algorithm: the hash table algorithm
default is murmur3 hash. options: jenkins, murmur3, xxh3
- no_lru_crawler: disable LRU Crawler background thread.
- lru_crawler_sleep: microseconds to sleep between items
default is 100.
- lru_crawler_tocrawl: max items to crawl per slab per run
default is 0 (unlimited)
- read_buf_mem_limit: limit in megabytes for connection read/response buffers.
do not adjust unless you have high (20k+) conn. limits.
0 means unlimited (default: 0)
- no_lru_maintainer: disable new LRU system + background thread.
- hot_lru_pct: pct of slab memory to reserve for hot lru.
(requires lru_maintainer, default pct: 20)
- warm_lru_pct: pct of slab memory to reserve for warm lru.
(requires lru_maintainer, default pct: 40)
- hot_max_factor: items idle > cold lru age * drop from hot lru. (default: 0.20)
- warm_max_factor: items idle > cold lru age * this drop from warm. (default: 2.00)
- temporary_ttl: TTL's below get separate LRU, can't be evicted.
(requires lru_maintainer, default: 61)
- idle_timeout: timeout for idle connections. (default: 0, no timeout)
- slab_chunk_max: (EXPERIMENTAL) maximum slab size in kilobytes. use extreme care. (default: 512)
- watcher_logbuf_size: size in kilobytes of per-watcher write buffer. (default: 256)
- worker_logbuf_size: size in kilobytes of per-worker-thread buffer
read by background thread, then written to watchers. (default: 64)
- track_sizes: enable dynamic reports for 'stats sizes' command.
- no_hashexpand: disables hash table expansion (dangerous)
- modern: enables options which will be default in future.
currently: nothing
- no_modern: uses defaults of previous major version (1.4.x)
- External storage (ext_*) related options (see: https://memcached.org/extstore)
- ext_path: file to write to for external storage.
ie: ext_path=/mnt/d1/extstore:1G
- ext_page_size: size in megabytes of storage pages. (default: 64)
- ext_wbuf_size: size in megabytes of page write buffers. (default: 4)
- ext_threads: number of IO threads to run. (default: 1)
- ext_item_size: store items larger than this (bytes, default 512)
- ext_item_age: store items idle at least this long (seconds, default: no age limit)
- ext_low_ttl: consider TTLs lower than this specially (default: 0)
- ext_drop_unread: don't re-write unread values during compaction (default: disabled)
- ext_recache_rate: recache an item every N accesses (default: 2000)
- ext_compact_under: compact when fewer than this many free pages
(default: 1/4th of the assigned storage)
- ext_drop_under: drop COLD items when fewer than this many free pages
(default: 1/4th of the assigned storage)
- ext_max_frag: max page fragmentation to tolerate (default: 0.80)
- slab_automove_freeratio: ratio of memory to hold free as buffer.
(see doc/storage.txt for more info, default: 0.010)
- ssl_chain_cert: certificate chain file in PEM format
- ssl_key: private key, if not part of the -ssl_chain_cert
- ssl_keyformat: private key format (PEM, DER or ENGINE) (default: PEM)
- ssl_verify_mode: peer certificate verification mode, default is 0(None).
valid values are 0(None), 1(Request), 2(Require)
or 3(Once)
- ssl_ciphers: specify cipher list to be used
- ssl_ca_cert: PEM format file of acceptable client CA's
- ssl_wbuf_size: size in kilobytes of per-connection SSL output buffer
(default: 16)
- ssl_session_cache: enable server-side SSL session cache, to support session
resumption
- ssl_min_version: minimum protocol version to accept (default: tlsv1.2)
valid values are 0(tlsv1.0), 1(tlsv1.1), 2(tlsv1.2), or 3(tlsv1.3).
-N, --napi_ids number of napi ids. see doc/napi_ids.txt for more details
启动
memcached -d -u root -m 20m -p 11211
-m 指定启动占用内存大小
-p 指定端口号
-d 启动守护进程
-u 指定用户
-c 指定连接数
-l 监听服务器的ip地址,127.0.0.1 0.0.0.0 任意地址都可以访问
关闭 memcached
pkill memcached
telnet ip port 连接memcached
ctrl + ]
quit 退出
ophelia@Ophelia:~$ telnet 127.0.0.1 11211
Trying 127.0.0.1...
Connected to 127.0.0.1.
Escape character is '^]'.
^]
telnet>
获取数据
get key
没有key对应的value 则返回空
ophelia@Ophelia:~$ telnet 127.0.0.1 11211
Trying 127.0.0.1...
Connected to 127.0.0.1.
Escape character is '^]'.
^]
telnet>
get key
END
添加数据
add key flags exptime bytes
value
只能添加不存在的key或过期了的key,存在的key添加则报错
add hello 0 60 5
world
STORED
set key flags exptime bytes
value
存在则修改,不存在则添加
set hello 0 120 5
hello
STORED
key:关键字,用于查找对应的value
flags:存储关于键值对的额外信息如(0|1|2)
exptime:过期时间以秒为单位,0表示永远,时间最长30天,用时间戳可以表示更长的时间(>30天)
bytes:缓存中存储的字节数
value:存储的值长度和bytes设置的一样
输出信息
STORED 保存成功
ERROR 保存失败
自增与自减
incr key increment_value
decr key increment_value
要求key 对应的value 必须是32位无符号数
increment_value:可以是任意有效数字
删除数据
delete key 删除key-value
flush_all 删除所有
用于删除已经存在的key
成功:DELETED
失败:NOT_FOUND
查看状态
stats
pid: memcached 进程父ID
uptime:服务器已运行秒数
curr_connections:当前连接数
cmd_get:get命令请求次数
cmd_set:set命令请求次数
get_hits:get命令命中次数
get_misses:get命令未命中次数
命中率计算:get_hits/cmd_get 60%~90%
提升命中率:增加有效期
stats
STAT pid 222
STAT uptime 2556
STAT time 1675826563
STAT version 1.6.14
STAT libevent 2.1.12-stable
STAT pointer_size 64
STAT rusage_user 0.274332
STAT rusage_system 0.147980
STAT max_connections 1024
STAT curr_connections 1
STAT total_connections 6
STAT rejected_connections 0
STAT connection_structures 2
STAT response_obj_oom 0
STAT response_obj_count 1
STAT response_obj_bytes 49152
STAT read_buf_count 7
STAT read_buf_bytes 114688
STAT read_buf_bytes_free 49152
STAT read_buf_oom 0
STAT reserved_fds 20
STAT cmd_get 4
STAT cmd_set 5
STAT cmd_flush 1
STAT cmd_touch 0
STAT cmd_meta 0
STAT get_hits 0
STAT get_misses 4
STAT get_expired 0
STAT get_flushed 0
STAT delete_misses 1
STAT delete_hits 1
STAT incr_misses 0
STAT incr_hits 3
STAT decr_misses 0
STAT decr_hits 1
STAT cas_misses 0
STAT cas_hits 0
STAT cas_badval 0
STAT touch_hits 0
STAT touch_misses 0
STAT store_too_large 0
STAT store_no_memory 0
STAT auth_cmds 0
STAT auth_errors 0
STAT bytes_read 374
STAT bytes_written 248
STAT limit_maxbytes 67108864
STAT accepting_conns 1
STAT listen_disabled_num 0
STAT time_in_listen_disabled_us 0
STAT threads 4
STAT conn_yields 0
STAT hash_power_level 16
STAT hash_bytes 524288
STAT hash_is_expanding 0
STAT slab_reassign_rescues 0
STAT slab_reassign_chunk_rescues 0
STAT slab_reassign_evictions_nomem 0
STAT slab_reassign_inline_reclaim 0
STAT slab_reassign_busy_items 0
STAT slab_reassign_busy_deletes 0
STAT slab_reassign_running 0
STAT slabs_moved 0
STAT lru_crawler_running 0
STAT lru_crawler_starts 10
STAT lru_maintainer_juggles 3640
STAT malloc_fails 0
STAT log_worker_dropped 0
STAT log_worker_written 0
STAT log_watcher_skipped 0
STAT log_watcher_sent 0
STAT log_watchers 0
STAT unexpected_napi_ids 0
STAT round_robin_fallback 0
STAT bytes 0
STAT curr_items 0
STAT total_items 5
STAT slab_global_page_pool 0
STAT expired_unfetched 2
STAT evicted_unfetched 0
STAT evicted_active 0
STAT evictions 0
STAT reclaimed 2
STAT crawler_reclaimed 0
STAT crawler_items_checked 1
STAT lrutail_reflocked 0
STAT moves_to_cold 5
STAT moves_to_warm 0
STAT moves_within_lru 0
STAT direct_reclaims 0
STAT lru_bumps_dropped 0
END