Java自定义异步事件,java – 正确的方法来停止自定义logback异步appender

我终于设法找到了一个解决方案,我认为这个解决方案不是最优的,而且远非简单,但它的工作正常.

我的第一次尝试是使用AWS SDK API的异步版本和提供的logback执行器,因为使用内部执行程序,可以避免中断问题.但是这没有用,因为工作队列是共享的,在这种情况下,队列必须是特定于appender才能正确停止它.所以我需要为每个appender使用自己的执行器.

首先,我需要AWS客户端的执行程序.执行程序的问题是提供的线程工厂必须创建守护程序线程,否则如果使用了logback的JVM关闭挂钩,它将无限期地阻塞.

public static ExecutorService newExecutor(Appender> appender, int threadPoolSize) {

final String name = appender.getName();

return Executors.newFixedThreadPool(threadPoolSize, new ThreadFactory() {

private final AtomicInteger idx = new AtomicInteger(1);

@Override

public Thread newThread(Runnable r) {

Thread thread = new Thread(r);

thread.setName(name + "-" + idx.getAndIncrement());

thread.setDaemon(true);

return thread;

}

});

}

下一个问题是如何使用中断正确停止appender?这需要通过重试处理中断的异常,因为否则执行程序将跳过等待队列刷新.

public static void shutdown(Appender> appender, ExecutorService executor, long waitMillis) {

executor.shutdown();

boolean completed = awaitTermination(appender, executor, waitMillis);

if (!completed) {

appender.addWarn(format("Executor for %s did not shut down in %d milliseconds, " +

"logging events might have been discarded",

appender.getName(), waitMillis));

}

}

private static boolean awaitTermination(Appender> appender, ExecutorService executor, long waitMillis) {

long started = System.currentTimeMillis();

try {

return executor.awaitTermination(waitMillis, TimeUnit.MILLISECONDS);

} catch (InterruptedException ie1) {

// the worker loop is stopped by interrupt, but the remaining queue should still be handled

long waited = System.currentTimeMillis() - started;

if (waited < waitMillis) {

try {

return executor.awaitTermination(waitMillis - waited, TimeUnit.MILLISECONDS);

} catch (InterruptedException ie2) {

appender.addError(format("Shut down of executor for %s was interrupted",

appender.getName()));

}

}

Thread.currentThread().interrupt();

}

return false;

}

正常的logback appender预计会以同步方式工作,因此即使没有正确的关闭挂钩也不应丢失日志记录事件.这是当前异步AWS SDK API调用的问题.我决定使用倒计时锁存器来提供阻塞appender行为.

public class LoggingEventHandler implements AsyncHandler {

private final ContextAware contextAware;

private final CountDownLatch latch;

private final String errorMessage;

public LoggingEventHandler(ContextAware contextAware, CountDownLatch latch, String errorMessage) {

this.contextAware = contextAware;

this.latch = latch;

this.errorMessage = errorMessage;

}

@Override

public void onError(Exception exception) {

contextAware.addWarn(errorMessage, exception);

latch.countDown();

}

@Override

public void onSuccess(REQUEST request, RESULT result) {

latch.countDown();

}

}

并用闩锁处理等待.

public static void awaitLatch(Appender> appender, CountDownLatch latch, long waitMillis) {

if (latch.getCount() > 0) {

try {

boolean completed = latch.await(waitMillis, TimeUnit.MILLISECONDS);

if (!completed) {

appender.addWarn(format("Appender '%s' did not complete sending event in %d milliseconds, " +

"the event might have been lost",

appender.getName(), waitMillis));

}

} catch (InterruptedException ex) {

appender.addWarn(format("Appender '%s' was interrupted, " +

"a logging event might have been lost or shutdown was initiated",

appender.getName()));

Thread.currentThread().interrupt();

}

}

}

然后全部捆绑在一起.以下示例是实际实现的简化版本,仅显示此问题的相关部分.

public class SqsAppender extends UnsynchronizedAppenderBase {

private AmazonSQSAsyncClient sqs;

@Override

public void start() {

sqs = new AmazonSQSAsyncClient(

getCredentials(),

getClientConfiguration(),

Executors.newFixedThreadPool(getThreadPoolSize())

);

super.start();

}

@Override

public void stop() {

super.stop();

if (sqs != null) {

AppenderExecutors.shutdown(this, sqs.getExecutorService(), getMaxFlushTime());

sqs.shutdown();

sqs = null;

}

}

@Override

protected void append(final ILoggingEvent eventObject) {

SendMessageRequest request = ...

CountDownLatch latch = new CountDownLatch(1);

sqs.sendMessageAsync(request, new LoggingEventHandler(this, latch, "Error"));

AppenderExecutors.awaitLatch(this, latch, getMaxFlushTime());

}

}

所有这些都是正确处理以下情况所必需的:

>使用异步appender包装时,在logback context stop或shutdown hook上刷新剩余事件队列

>当使用logback的延迟关闭挂钩时,不要无限期地阻塞

>在不使用异步appender时提供阻止行为

>从async appender stop的中断生存,导致所有AWS SDK流实现中断

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Logback 支持异步输出日志,可以提高程序的性能。 在 Logback 中,异步输出主要通过 AsyncAppender 实现。AsyncAppender 是一个装饰器模式的 Appender,它可以将同步的 Appender 转换为异步Appender。 使用 AsyncAppender 时,需要指定一个 BlockingQueue 用于缓存日志事件,以及一个 Executor 用于执行日志事件。日志事件会被添加到 BlockingQueue 中,然后由 Executor 异步地处理。 以下是一个使用 AsyncAppender 的配置示例: ```xml <configuration> <appender name="CONSOLE" class="ch.qos.logback.core.ConsoleAppender"> <encoder> <pattern>%d{yyyy-MM-dd HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg%n</pattern> </encoder> </appender> <appender name="ASYNC_CONSOLE" class="ch.qos.logback.classic.AsyncAppender"> <appender-ref ref="CONSOLE" /> <queueSize>512</queueSize> <discardingThreshold>0</discardingThreshold> <includeCallerData>false</includeCallerData> </appender> <root level="debug"> <appender-ref ref="ASYNC_CONSOLE" /> </root> </configuration> ``` 在上面的配置中,我们首先定义了一个 ConsoleAppender,然后定义了一个 AsyncAppender(ASYNC_CONSOLE),并将 ConsoleAppender 作为它的子节点。我们还设置了 queueSize 和 discardingThreshold 参数,这两个参数用于控制当缓存队列已满时如何处理新的日志事件。 最后,我们将 AsyncAppender(ASYNC_CONSOLE)设置为 root loggerAppender。 通过这样的配置,我们就可以在 Logback 中实现异步输出日志了。
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值