卡夫卡监听器中的钩子

时间:2020-01-22 07:09:35

标签: spring apache-kafka slf4j spring-kafka mdc

在kafka收听消息之前/之后,是否有任何可用的钩子?

用例: 必须设置MDC关联ID才能执行日志可追溯性

我正在寻找什么? 一种事前/事后回调方法,以便可以在进入时设置MDC关联ID,并在退出时最终清除MDC。

编辑场景: 作为Kafka标头的一部分,我正在获取关联ID,一旦在Kafka Listener中收到消息,我想在MDC中设置相同的ID。

感谢帮助

1 个答案:

答案 0 :(得分:2)

您可以在侦听器bean中添加周围建议...

@SpringBootApplication
public class So59854374Application {

    public static void main(String[] args) {
        SpringApplication.run(So59854374Application.class, args);
    }

    @Bean
    public static BeanPostProcessor bpp() { // static is important
        return new BeanPostProcessor() {

            @Override
            public Object postProcessBeforeInitialization(Object bean, String beanName) throws BeansException {
                if (bean instanceof MyListener) {
                    ProxyFactoryBean pfb = new ProxyFactoryBean();
                    pfb.setTarget(bean);
                    pfb.addAdvice(new MethodInterceptor() {

                        @Override
                        public Object invoke(MethodInvocation invocation) throws Throwable {
                            try {
                                System.out.println("Before");
                                return invocation.proceed();
                            }
                            finally {
                                System.out.println("After");
                            }
                        }

                    });
                    return pfb.getObject();
                }
                return bean;
            }

        };
    }

    @Bean
    public NewTopic topic() {
        return TopicBuilder.name("so59854374").partitions(1).replicas(1).build();
    }

    @Bean
    public ApplicationRunner runner(KafkaTemplate<String, String> template) {
        return args -> template.send("so59854374", "foo");
    }

}

@Component
class MyListener {

    @KafkaListener(id = "so59854374", topics = "so59854374")
    public void listen(String in) {
        System.out.println(in);
    }

}

Before
foo
After

编辑

如果将@Header("myMdcHeader") byte[] mdc添加为kafka侦听器方法的附加参数,则可以在调用上使用getArguments()[1]

另一种解决方案是将RecordInterceptor添加到侦听器容器工厂,这使您可以在将原始ConsumerRecord传递给侦听器适配器之前对其进行访问。

/**
 * An interceptor for {@link ConsumerRecord} invoked by the listener
 * container before invoking the listener.
 *
 * @param <K> the key type.
 * @param <V> the value type.
 *
 * @author Gary Russell
 * @since 2.2.7
 *
 */
@FunctionalInterface
public interface RecordInterceptor<K, V> {

    /**
     * Perform some action on the record or return a different one.
     * If null is returned the record will be skipped.
     * @param record the record.
     * @return the record or null.
     */
    @Nullable
    ConsumerRecord<K, V> intercept(ConsumerRecord<K, V> record);

}
/**
 * Set an interceptor to be called before calling the listener.
 * Does not apply to batch listeners.
 * @param recordInterceptor the interceptor.
 * @since 2.2.7
 */
public void setRecordInterceptor(RecordInterceptor<K, V> recordInterceptor) {
    this.recordInterceptor = recordInterceptor;
}

如果您使用的是批处理侦听器,Kafka将提供ConsumerInterceptor