Docker部署RocketMQ双主双从模式

Docker部署RocketMQ双主双从模式（在一台机子上部署）

结构图

image

Broker 常用配置参数

image

以下属性仅做说明使用

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
#所属集群名字
brokerClusterName=rocketmq-cluster
#broker 名字，注意此处不同的配置文件填写的不一样
brokerName=broker-a
#0 表示 Master， >0 表示 Slave
brokerId=0
#nameServer 地址，分号分割
namesrvAddr=rocketmq-nameserver1:9876
#在发送消息时，自动创建服务器不存在的 topic，默认创建的队列数
defaultTopicQueueNums=4
#是否允许 Broker 自动创建 Topic，建议线下开启，线上关闭
autoCreateTopicEnable=true
#是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭
autoCreateSubscriptionGroup=true
#Broker 对外服务的监听端口
listenPort=10911
#删除文件时间点，默认凌晨 4 点
deleteWhen=04
#文件保留时间，默认 48 小时
fileReservedTime=120
#commitLog 每个文件的大小默认 1G
mapedFileSizeCommitLog=1073741824
#ConsumeQueue 每个文件默认存 30W 条，根据业务情况调整
mapedFileSizeConsumeQueue=300000
#destroyMapedFileIntervalForcibly=120000
#redeleteHangedFileInterval=120000
#检测物理文件磁盘空间
diskMaxUsedSpaceRatio=88
#存储路径
storePathRootDir=/usr/local/rocketmq/store
#commitLog 存储路径
storePathCommitLog=/usr/local/rocketmq/store/commitlog
#消费队列存储路径存储路径
storePathConsumeQueue=/usr/local/rocketmq/store/consumequeue
#消息索引存储路径
storePathIndex=/usr/local/rocketmq/store/index
#checkpoint 文件存储路径
storeCheckpoint=/usr/local/rocketmq/store/checkpoint
#abort 文件存储路径
abortFile=/usr/local/rocketmq/store/abort
#限制的消息大小
maxMessageSize=65536
#flushCommitLogLeastPages=4
#flushConsumeQueueLeastPages=2
#flushCommitLogThoroughInterval=10000
#flushConsumeQueueThoroughInterval=60000
#Broker 的角色
#- ASYNC_MASTER 异步复制 Master
#- SYNC_MASTER 同步双写 Master
#- SLAVE
brokerRole=ASYNC_MASTER
#刷盘方式
#- ASYNC_FLUSH 异步刷盘
#- SYNC_FLUSH 同步刷盘
flushDiskType=ASYNC_FLUSH
#checkTransactionMessageEnable=false
#发消息线程池数量
#sendMessageThreadPoolNums=128
#拉消息线程池数量
#pullMessageThreadPoolNums=128

获取相关镜像

参考：Docker安装RocketMQ

创建持久化目录

rocketmq

image

1
2
3
4
5
6
7
8
9
10
11
12
13
# 创建 NameServer 持久化目录
mkdir -p /usr/local/docker/rocketmq/namesrv/logs && \
mkdir -p /usr/local/docker/rocketmq/namesrv/store

# 创建 Broker-Master 持久化目录
mkdir -p /usr/local/docker/rocketmq/broker/logs && \
mkdir -p /usr/local/docker/rocketmq/broker/store && \
touch /usr/local/docker/rocketmq/broker/broker.conf

# 创建 Broker-Slave 持久化目录
mkdir -p /usr/local/docker/rocketmq/broker-slave/logs && \
mkdir -p /usr/local/docker/rocketmq/broker-slave/store && \
touch /usr/local/docker/rocketmq/broker-slave/broker.conf

rocketmq_2

image

1
2
3
4
5
6
7
8
9
10
11
12
13
# 创建 NameServer 持久化目录
mkdir -p /usr/local/docker/rocketmq_2/namesrv/logs && \
mkdir -p /usr/local/docker/rocketmq_2/namesrv/store

# 创建 Broker-Master 持久化目录
mkdir -p /usr/local/docker/rocketmq_2/broker/logs && \
mkdir -p /usr/local/docker/rocketmq_2/broker/store && \
touch /usr/local/docker/rocketmq_2/broker/broker.conf

# 创建 Broker-Slave 持久化目录
mkdir -p /usr/local/docker/rocketmq_2/broker-slave/logs && \
mkdir -p /usr/local/docker/rocketmq_2/broker-slave/store && \
touch /usr/local/docker/rocketmq_2/broker-slave/broker.conf

修改 Broker 配置文件

rocketmq/broker/broker.conf

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
brokerClusterName = DefaultCluster  
brokerName = broker-a
brokerId = 0  
deleteWhen = 04  
fileReservedTime = 48  
brokerRole = ASYNC_MASTER  
flushDiskType = ASYNC_FLUSH  
# 如果是本地程序调用云主机 mq，设置成 云主机 IP
# 如果Docker环境，设置成宿主机IP
# brokerIP1 = {docker宿主机IP}
brokerIP1 = 192.168.198.200
#是否允许 Broker 自动创建Topic，建议线下开启，线上关闭 
autoCreateTopicEnable=true
#是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭 
autoCreateSubscriptionGroup=true

# nameServer 地址，分号分割
namesrvAddr=192.168.198.200:9876;192.168.198.200:9877

listenPort=10911

rocketmq/broker-slave/broker.conf

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
brokerClusterName = DefaultCluster
brokerName = broker-b
brokerId = 1
deleteWhen = 04
fileReservedTime = 48
brokerRole = SLAVE
flushDiskType = ASYNC_FLUSH
# 如果是本地程序调用云主机 mq，设置成 云主机 IP
# 如果Docker环境，设置成宿主机IP
# brokerIP1 = {docker宿主机IP}
brokerIP1 = 192.168.198.200
#是否允许 Broker 自动创建Topic，建议线下开启，线上关闭
autoCreateTopicEnable=true
#是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭
autoCreateSubscriptionGroup=true

# nameServer 地址，分号分割
namesrvAddr=192.168.198.200:9876;192.168.198.200:9877

listenPort=11911

rocketmq_2/broker/broker.conf

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
brokerClusterName = DefaultCluster  
brokerName = broker-b
brokerId = 0 
deleteWhen = 04  
fileReservedTime = 48  
brokerRole = SYNC_MASTER  
flushDiskType = ASYNC_FLUSH  
# 如果是本地程序调用云主机 mq，设置成 云主机 IP
# 如果Docker环境，设置成宿主机IP
# brokerIP1 = {docker宿主机IP}
brokerIP1 = 192.168.198.200
# 是否允许 Broker 自动创建Topic，建议线下开启，线上关闭 
autoCreateTopicEnable=true
# 是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭 
autoCreateSubscriptionGroup=true

# nameServer 地址，分号分割
namesrvAddr=192.168.198.200:9876;192.168.198.200:9877

listenPort=10911

rocketmq_2/broker-slave/broker.conf

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
brokerClusterName = DefaultCluster
brokerName = broker-a
brokerId = 1
deleteWhen = 04
fileReservedTime = 48
brokerRole = SLAVE
flushDiskType = ASYNC_FLUSH
# 如果是本地程序调用云主机 mq，设置成 云主机 IP
# 如果Docker环境，设置成宿主机IP
# brokerIP1 = {docker宿主机IP}
brokerIP1 = 192.168.198.200
# 是否允许 Broker 自动创建Topic，建议线下开启，线上关闭
autoCreateTopicEnable=true
# 是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭
autoCreateSubscriptionGroup=true

# nameServer 地址，分号分割
namesrvAddr=192.168.198.200:9876;192.168.198.200:9877

listenPort=11911

启动NameServer

rocketmq

1
docker run -d -p 9876:9876 -v /usr/local/docker/rocketmq/namesrv/logs:/root/logs -v /usr/local/docker/rocketmq/namesrv/store:/root/store --name rmqnamesrv -e "MAX_POSSIBLE_HEAP=100000000" rocketmqinc/rocketmq sh mqnamesrv

rocketmq_2

1
docker run -d -p 9877:9876 -v /usr/local/docker/rocketmq_2/namesrv/logs:/root/logs -v /usr/local/docker/rocketmq_2/namesrv/store:/root/store --name rmqnamesrv_2 -e "MAX_POSSIBLE_HEAP=100000000" rocketmqinc/rocketmq sh mqnamesrv

启动Broker

rocketmq master-a

1
docker run -d -p 10909:10909 -p 10911:10911 -p 10912:10912 -v  /usr/local/docker/rocketmq/broker/logs:/root/logs -v  /usr/local/docker/rocketmq/broker/store:/root/store -v  /usr/local/docker/rocketmq/broker/broker.conf:/opt/rocketmq/conf/broker.conf --name rmqbroker-master --link rmqnamesrv:namesrv -e "MAX_POSSIBLE_HEAP=200000000" rocketmqinc/rocketmq sh mqbroker -c /opt/rocketmq/conf/broker.conf

rocketmq_2 slave-a

1
docker run -d -p 11909:11909 -p 11911:11911 -p 11912:11912 -v  /usr/local/docker/rocketmq_2/broker-slave/logs:/root/logs -v  /usr/local/docker/rocketmq_2/broker-slave/store:/root/store -v  /usr/local/docker/rocketmq_2/broker-slave/broker.conf:/opt/rocketmq/conf/broker.conf --name rmqbroker_2-slave --link rmqnamesrv_2:namesrv -e "MAX_POSSIBLE_HEAP=200000000" rocketmqinc/rocketmq sh mqbroker -c /opt/rocketmq/conf/broker.conf

ocketmq_2 master-b

1
docker run -d -p 12909:10909 -p 12911:10911 -p 12912:10912 -v  /usr/local/docker/rocketmq_2/broker/logs:/root/logs -v  /usr/local/docker/rocketmq_2/broker/store:/root/store -v  /usr/local/docker/rocketmq_2/broker/broker.conf:/opt/rocketmq/conf/broker.conf --name rmqbroker_2-master --link rmqnamesrv_2:namesrv -e "MAX_POSSIBLE_HEAP=200000000" rocketmqinc/rocketmq sh mqbroker -c /opt/rocketmq/conf/broker.conf

rocketmq slave-b

1
docker run -d -p 13909:11909 -p 13911:11911 -p 13912:11912 -v  /usr/local/docker/rocketmq/broker-slave/logs:/root/logs -v  /usr/local/docker/rocketmq/broker-slave/store:/root/store -v  /usr/local/docker/rocketmq/broker-slave/broker.conf:/opt/rocketmq/conf/broker.conf --name rmqbroker-slave --link rmqnamesrv:namesrv -e "MAX_POSSIBLE_HEAP=200000000" rocketmqinc/rocketmq sh mqbroker -c /opt/rocketmq/conf/broker.conf

启动控制台

1
docker run -d -p 8083:8080 -e "JAVA_OPTS=-Drocketmq.config.namesrvAddr=192.168.198.200:9876;192.168.198.200:9877 -Drocketmq.config.isVIPChannel=false" --name rocketmq-console-ng styletang/rocketmq-console-ng

访问控制台

image

tag:

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录（注意不是yilia根目录）执行以下命令：
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置： 

      jsonContent:
    meta: false
    pages: false
    posts:
      title: true
      date: true
      path: true
      text: false
      raw: false
      content: false
      slug: false
      updated: false
      comments: false
      link: false
      permalink: false
      excerpt: false
      categories: false
      tags: true

徘徊在原子与字节的边缘<br><br>将更好的自己呈现给世界<br><br><br><br>修心至要，事上磨练<br><br>一蓑衣，一壶酒，一曲长歌，一剑天涯<br><br>见自己，见天地，见众生<br><br>