[Backend] MQTTBrokerL: EMQ Getting started_emqxloadedplugins: |-CSDN博客

本文链接：https://blog.csdn.net/u014757414/article/details/112614683

本文介绍了EMQ X Broker的快速启动、配置修改、访问控制、插件管理以及Docker容器的使用方法，包括配置文件的修改、REST API的介绍、插件加载和集群设置。同时，文章提到了内核调优和安全性注意事项。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

EMQX => mqttbroker

docs: https://developer.emqx.io/docs/broker/v3/cn/

Build From Source The EMQ X broker requires Erlang/OTP R21+ to build since 3.0 release.

git clone https://github.com/emqx/emqx-rel.git
cd emqx-rel && make
cd _build/emqx/rel/emqx && ./bin/emqx console

Quick Start

# Start emqx
./bin/emqx start
# Check Status
./bin/emqx_ctl status
# Stop emqx
./bin/emqx stop

修改配置文件之后需要　emqx restart 重启生效

默认访问控制设置

EMQ X 消息服务器默认访问控制，在 etc/emqx.conf 中设置:

## 设置所有 ACL 规则都不能匹配时是否允许访问
## Value: allow | deny
acl_nomatch = allow

## 设置存储 ACL 规则的默认文件
## Value: File Name
acl_file = etc/acl.conf

ACL 规则定义在 etc/acl.conf，EMQ X 启动时加载到内存:

%% 允许 'dashboard' 用户订阅 '$SYS/#'
{allow, {user, "dashboard"}, subscribe, ["$SYS/#"]}.

%% 允许本机用户发布订阅全部主题
{allow, {ipaddr, "127.0.0.1"}, pubsub, ["$SYS/#", "#"]}.

%% 拒绝除本机用户以外的其他用户订阅 '$SYS/#' 与 '#' 主题
{deny, all, subscribe, ["$SYS/#", {eq, "#"}]}.

%% 允许上述规则以外的任何情形
{allow, all}.

plugins

emqx_auth_username

EMQ X Authentication with Username and Password

Configuration

etc/emqx_auth_username.conf:

## Password hash.
##
## Value: plain | md5 | sha | sha256 
auth.user.password_hash = sha256

REST Api

REST API https://developer.emqx.io/docs/emq/v3/en/rest.html

List all usernames

# Request
GET api/v3/auth_username

# Response
{
    "code": 0,
    "data": ["username1"]
}

Add a username:

# Request
POST api/v3/auth_username
{
    "username": "some_name",
    "password": "password"
}

# Response
{
    "code": 0
}

Update password for a username:

# Request
PUT api/v3/auth_username/$NAME
{
    "password": "password"
}

# Response
{
    "code", 0
}

Lookup a username info:

# Request
GET api/v3/auth_username/$NAME

# Response
{
    "code": 0,
    "data": {
        "username": "some_username",
        "password": "hashed_password"
    }
}

Delete a username:

# Request
DELETE api/v3/auth_username/$NAME

# Response
{
    "code": 0
}

Load the Plugin

./bin/emqx_ctl plugins load emqx_auth_username

EMQ X Docker

EMQ (Erlang MQTT Broker) is a distributed, massively scalable, highly extensible MQTT messaging broker written in Erlang/OTP.

Current docker image size: 47 MB

Run emqx

Execute some command under this docker image

docker run -d -v `pwd`:$(somewhere) emqx/emqx:$(tag) $(somecommand)

For example

docker run -d --name emqx -p 18083:18083 -p 1883:1883 emqx/emqx:latest

The emqx broker runs as linux user emqx in the docker container.

Configuration

Use the environment variable to configure the EMQ X docker container.

The environment variables which with EMQX_ prefix are mapped to configuration file, . get replaced by __.

Example:

EMQX_LISTENER__SSL__EXTERNAL__ACCEPTORS <--> listener.ssl.external.acceptors
EMQX_MQTT__MAX_PACKET_SIZE              <--> mqtt.max_packet_size

Also the environment variables which with PLATFORM_ prefix are mapped to template string in configuration file.

PLATFORM_ETC_DIR                   <--> {{ platform_etc_dir }}

Non mapped environment variables:

EMQX_NAME
EMQX_HOST

These environment variables will ignore for configuration file.

EMQ X Configuration

NOTE: All EMQ X Configuration in etc/emqx.conf could config by environment. The following list is just an example, not a complete configuration.

Options	Default	Mapped	Description
EMQX_NAME	container name	none	emqx node short name
EMQX_HOST	container IP	none	emqx node host, IP or FQDN
EMQX_WAIT_TIME	5	none	wait time in sec before timeout
PLATFORM_ETC_DIR	/opt/emqx/etc	{{ platform_etc_dir }}	The etc directory
PLATFORM_LOG_DIR	/opt/emqx/log	{{ platform_log_dir }}	The log directory
EMQX_NODE__NAME	EMQX_NAME@EMQX_HOST	node.name	Erlang node name, name@ipaddress/host
EMQX_NODE__COOKIE	emqx_dist_cookie	node.cookie	cookie for cluster
EMQX_LOG__CONSOLE	console	log.console	log console output method
EMQX_ALLOW_ANONYMOUS	true	allow_anonymous	allow mqtt anonymous login
EMQX_LISTENER__TCP__EXTERNAL	1883	listener.tcp.external	MQTT TCP port
EMQX_LISTENER__SSL__EXTERNAL	8883	listener.ssl.external	MQTT TCP TLS/SSL port
EMQX_LISTENER__WS__EXTERNAL	8083	listener.ws.external	HTTP and WebSocket port
EMQX_LISTENER__WSS__EXTERNAL	8084	listener.wss.external	HTTPS and WSS port
EMQX_LISTENER__API__MGMT	8080	listener.api.mgmt	MGMT API port
EMQX_MQTT__MAX_PACKET_SIZE	64KB	mqtt.max_packet_size	Max Packet Size Allowed

The list is incomplete and may changed with etc/emqx.conf and plugin configuration files. But the mapping rule is similar.

If set EMQX_NAME and EMQX_HOST, and unset EMQX_NODE__NAME, EMQX_NODE__NAME=$EMQX_NAME@$EMQX_HOST.

For example, set mqtt tcp port to 1883

docker run -d --name emqx -e EMQX_LISTENER__TCP__EXTERNAL=1883 -p 18083:18083 -p 1883:1883 emqx/emqx:latest

EMQ Loaded Plugins Configuration

Oprtions	Default	Description
EMQX_LOADED_PLUGINS	see content below	default plugins emqx loaded

Default environment variable EMQX_LOADED_PLUGINS, including

emqx_recon
emqx_retainer
emqx_management
emqx_dashboard

# The default EMQX_LOADED_PLUGINS env
EMQX_LOADED_PLUGINS="emqx_recon,emqx_retainer,emqx_management,emqx_dashboard"

When you need to customize the loaded plugin, emqx_management must be loaded in the first place.

For example, load emqx_auth_redis plugin, set it into EMQX_LOADED_PLUGINS and use any separator to separates it.

You can use comma, space or other separator that you want.

All the plugin you defined in env EMQX_LOADED_PLUGINS will be loaded.

EMQX_LOADED_PLUGINS="emqx_management,emqx_auth_redis,emqx_recon,emqx_retainer,emqx_dashboard"
EMQX_LOADED_PLUGINS="emqx_management emqx_auth_redis emqx_recon emqx_retainer emqx_dashboard"
EMQX_LOADED_PLUGINS="emqx_management | emqx_auth_redis | emqx_recon | emqx_retainer | emqx_dashboard"

EMQ X Plugins Configuration

The environment variables which with EMQX_ prefix are mapped to all emqx plugins' configuration file, . get replaced by __.

Example:

EMQX_AUTH__REDIS__SERVER   <--> auth.redis.server
EMQX_AUTH__REDIS__PASSWORD <--> auth.redis.password

Don't worry about where to find the configuration file of emqx plugins, this docker image will find and config them automatically using some magic.

All plugin of emqx project could config in this way, following the environment variables mapping rule above.

Assume you are using redis auth plugin, for example:

#EMQX_AUTH__REDIS__SERVER="redis.at.yourserver"
#EMQX_AUTH__REDIS__PASSWORD="password_for_redis"

docker run -d --name emqx -p 18083:18083 -p 1883:1883 -p 4369:4369 \
    -e EMQX_LISTENER__TCP__EXTERNAL=1883 \
    -e EMQX_LOADED_PLUGINS="emqx_auth_redis,emqx_recon,emqx_retainer,emqx_management,emqx_dashboard" \
    -e EMQX_AUTH__REDIS__SERVER="your.redis.server:6379" \
    -e EMQX_AUTH__REDIS__PASSWORD="password_for_redis" \
    -e EMQX_AUTH__REDIS__PASSWORD_HASH=plain \
    emqx/emqx:latest

Cluster

You can specify a initial cluster and join.

Note: You must publsh port 4369, 5369 and range of port 6000-6999 for EMQ X Cluster.

For example, using 6000-6100 for cluster.


docker run -d --name emqx -p 18083:18083 -p 1883:1883 -p 4369:4369 -p 6000-6100:6000-6100 \
    -e EMQX_NAME="emqx" \
    -e EMQX_HOST="t.emqx.io" \
    -e EMQX_LISTENER__TCP__EXTERNAL=1883 \
    -e EMQX_JOIN_CLUSTER="emqx@t.emqx.io" \
    emqx/emqx:latest

Kernel Tuning

Under linux host machine, the easiest way is tuning host machine's kernel.

If you want tune linux kernel by docker, you must ensure your docker is latest version (>=1.12).


docker run -d --name emqx -p 18083:18083 -p 1883:1883 -p 4369:4369 \
    --sysctl fs.file-max=2097152 \
    --sysctl fs.nr_open=2097152 \
    --sysctl net.core.somaxconn=32768 \
    --sysctl net.ipv4.tcp_max_syn_backlog=16384 \
    --sysctl net.core.netdev_max_backlog=16384 \
    --sysctl net.ipv4.ip_local_port_range=1000 65535 \
    --sysctl net.core.rmem_default=262144 \
    --sysctl net.core.wmem_default=262144 \
    --sysctl net.core.rmem_max=16777216 \
    --sysctl net.core.wmem_max=16777216 \
    --sysctl net.core.optmem_max=16777216 \
    --sysctl net.ipv4.tcp_rmem=1024 4096 16777216 \
    --sysctl net.ipv4.tcp_wmem=1024 4096 16777216 \
    --sysctl net.ipv4.tcp_max_tw_buckets=1048576 \
    --sysctl net.ipv4.tcp_fin_timeout=15 \
    emqx/emqx:latest