English 中文(简体)
Kafka stream for processing event which takes long time
原标题：

I have a Spring Boot Kafka Stream application that reads the records do some HTTP calls and transform the record into another form. This transform record is then sent to the producer.

final KStream<String, String> toSquare = builder.stream(eventTopic,
                Consumed.with(Serdes.String(), Serdes.String()));
toSquare.mapValues(recodProcessor::processMessage).to(notificationTopic,
                Produced.with(Serdes.String(), Serdes.String()));

Sometimes processMessage method is taking more than 5 min to execute based on the input event. max.poll.interval.ms is configured as 5 min. This is triggering rebalancing. Also, we are seeing the lag start building up for the particular partition.

How Kafka stream can be configured to handle such a scenario like throwing an error and pushing a record in DLQ and moving to the next record?

问题回答

暂无回答


上一篇：
下一篇：


相关问题
Kafka stream for processing event which takes long time

I have a Spring Boot Kafka Stream application that reads the records do some HTTP calls and transform the record into another form. This transform record is then sent to the producer. final KStream<...

时间：2023-05-27 02:56:43 回答：0 展示：1
热门标签

友情链接

Allggapp Alljchome-教程家园 mvfinale.com-影视剧情大结局大全