RocketMQ4.5.X 实现修改生产者消费者日志保存路径
作者:qq_35251168 时间:2021-05-24 23:58:37
RocketMQ修改生产者消费者日志保存路径
rocket默认是将所有日志文件保存到user.home的对于win系统就是C盘了。
1.修改RocketMQ中CLientLogger.class的源码,把经过更改的源码重新打包后,去自己的maven仓库替换rocketmq-client.-4.5.X.jar。
2.对于生产者的启动类里需要配置JVM系统属性:
如果不设置logUserSlf4j为true的话,启动生产者的时候会报找不到日志配置文件的警告。
3.对于消费者,仅仅添加rq.lordir(日志保存路径)就行了。
当然,以上情况是开发中每个开发人员需要独立设置的,部署到线上的时候可以直接在源码中写路径而不是系统属性。
RocketMQ 日志操作
官网:http://rocketmq.apache.org/docs/logappender-example/
应用:将程序日志输出到rocketmq,消费端可读取日志数据进行相应处理
导入 jar 包
<dependency>
<groupId>org.apache.rocketmq</groupId>
<artifactId>rocketmq-logappender</artifactId>
<version>4.7.1</version>
</dependency>
相关类
RocketmqLogbackAppender
:发送到rocketmq
public class RocketmqLogbackAppender extends AppenderBase<ILoggingEvent> {
private String tag; //标签
private String topic; //发送的topic
private String nameServerAddress; //namesrv地址
private String producerGroup; //发送群组
private MQProducer producer;
private Layout layout; //布局方式
private PreSerializationTransformer<ILoggingEvent> pst = new LoggingEventPreSerializationTransformer();
AsyncAppender
:异步发送
public class AsyncAppender extends AsyncAppenderBase<ILoggingEvent> {
boolean includeCallerData = false;
AsyncAppenderBase
public class AsyncAppenderBase<E> extends UnsynchronizedAppenderBase<E>
implements AppenderAttachable<E> {
AppenderAttachableImpl<E> aai = new AppenderAttachableImpl<E>();
BlockingQueue<E> blockingQueue;
public static final int DEFAULT_QUEUE_SIZE = 256;
int queueSize = DEFAULT_QUEUE_SIZE;
int appenderCount = 0;
static final int UNDEFINED = -1;
int discardingThreshold = UNDEFINED;
boolean neverBlock = false;
Worker worker = new Worker();
public static final int DEFAULT_MAX_FLUSH_TIME = 1000;
int maxFlushTime = DEFAULT_MAX_FLUSH_TIME;
AppenderAttachable
:引用、删除appender
public interface AppenderAttachable<E> {
void addAppender(Appender<E> newAppender);
boolean isAttached(Appender<E> appender);
Iterator<Appender<E>> iteratorForAppenders();
Appender<E> getAppender(String name);
void detachAndStopAllAppenders();
boolean detachAppender(Appender<E> appender);
boolean detachAppender(String name);
}
日志配置
logback.xml:放在resources目录下
<?xml version="1.0" encoding="UTF-8"?>
<configuration debug="false">
<conversionRule conversionWord="clr" converterClass="org.springframework.boot.logging.logback.ColorConverter"/>
<conversionRule conversionWord="wex" converterClass="org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter"/>
<conversionRule conversionWord="wEx" converterClass="org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter"/>
<property name="log.path" value="e:/hhhh/"/>
<property name="console.pattern" value="%clr(%d{${LOG_DATEFORMAT_PATTERN:-yyyy-MM-dd HH:mm:ss.SSS}}){faint} %clr(${LOG_LEVEL_PATTERN:-%5p}) %clr(${PID:- }){magenta} %clr(---){faint} %clr([%15.15t]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n${LOG_EXCEPTION_CONVERSION_WORD:-%wEx}"/>
<property name="file.pattern" value="%d{${LOG_DATEFORMAT_PATTERN:-yyyy-MM-dd HH:mm:ss.SSS}} ${LOG_LEVEL_PATTERN:-%5p} ${PID:- } --- [%t] %-40.40logger{39} : %m%n${LOG_EXCEPTION_CONVERSION_WORD:-%wEx}"/>
<appender name="console" class="ch.qos.logback.core.ConsoleAppender">
<encoder>
<pattern>${console.pattern}</pattern>
</encoder>
</appender>
<appender name="mqAppender1" class="org.apache.rocketmq.logappender.logback.RocketmqLogbackAppender">
<tag>tag</tag>
<topic>topic-log</topic>
<producerGroup>log-group</producerGroup>
<nameServerAddress>172.18.0.10:9876</nameServerAddress>
<layout>
<pattern>%date %p %t - %m%n</pattern>
</layout>
</appender>
<!-- 异步发送 -->
<appender name="mqAsyncAppender1" class="ch.qos.logback.classic.AsyncAppender">
<queueSize>1024</queueSize>
<discardingThreshold>80</discardingThreshold>
<maxFlushTime>2000</maxFlushTime>
<neverBlock>true</neverBlock>
<appender-ref ref="mqAppender1"/>
</appender>
<root level="info">
<appender-ref ref="console"/>
<appender-ref ref="mqAsyncAppender1"/>
</root>
</configuration>
将springboot应用打包,发布成docker容器
创建容器
#namesrv
docker run -it -d --net fixed --ip 172.18.0.10 -p 9876:9876 \
-e JAVA_OPT="-server -Xms256m -Xmx256m -Xmn128m" \
--name namesrv lihu12344/rocketmq:4.7.1 bash bin/mqnamesrv
#broker
docker run -it -d --net fixed --ip 172.18.0.20 \
-e NAMESRV_ADDR="172.18.0.10:9876" \
-e JAVA_OPT="-server -Xms512m -Xmx512m -Xmn256m" \
-v /usr/rocketmq/single/broker.conf:/home/rocketmq/rcketmq-4.7.1/conf/broker.conf \
--name broker lihu12344/rocketmq:4.7.1 \
bash bin/mqbroker autoCreateTopicEnable=true -c conf/broker.conf
#应用程序
docker run -it -d --net fixed --ip 172.18.0.21 -p 8080:8080 --name rocketmq-log rocketmq-log
rocketmq监控
docker run -it -d --net fixed --ip 172.18.0.4 -p 8008:8080 \
-e "JAVA_OPTS=-Drocketmq.namesrv.addr=172.18.0.10:9876 -Dcom.rocketmq.sendMessageWithVIPChannel=false" \
--name rocketmq-console styletang/rocketmq-console-ng
使用测试
192.168.57.127:8008
查看topic
查看topic-log message信息
来源:https://blog.csdn.net/qq_35251168/article/details/99695159
标签:RocketMQ,生产者,消费者,日志,路径
0
投稿
猜你喜欢
java selenium使用浏览器调试工具实现方法
2023-07-27 04:04:22
SpringBoot集成Spring Security用JWT令牌实现登录和鉴权的方法
2023-07-02 22:48:29
谈谈你可能并不了解的java枚举
2023-11-09 21:08:55
springboot整合JSR303参数校验与全局异常处理的方法
2023-10-06 01:31:40
java利用数组随机抽取幸运观众
2023-11-11 11:14:33
IDEA快速搭建spring boot项目教程(Spring initializr)
2023-08-17 21:11:16
Java实现按行读取大文件
2022-11-05 13:56:57
IDEA中配置文件模板的添加方法
2023-10-28 17:52:31
Java拦截器Interceptor实现原理及代码示例
2023-11-04 03:49:32
ShardingSphere jdbc集成多数据源的实现步骤
2023-11-25 07:54:56
学习SpringBoot容器功能及注解原理
2023-11-24 22:06:17
SpringBoot使用Mybatis&Mybatis-plus文件映射配置方法
2023-05-16 12:53:02
Java实现Redis的集合(set)命令操作
2022-05-08 11:07:03
Spring boot集成Mybatis的方法教程
2023-11-25 06:20:41
Spring Boot 读取静态资源文件的方法
2023-08-25 02:53:07
springboot搭建访客管理系统的实现示例
2023-09-02 13:10:41
IDEA插件EasyCode及MyBatis最优配置步骤详解
2023-11-09 03:19:19
java文件操作输入输出结构详解
2023-07-30 21:48:30
Java中如何动态创建接口的实现方法
2023-11-25 15:13:02
SpringBoot 整合jdbc和mybatis的方法
2023-08-10 12:51:09