kafka 5节点集群宕机一个节点导致无法消费

木木&很呆 发表于: 2022-06-06   最后更新时间: 2022-06-07 10:50:47   908 游览

遇到一个5节点的集群,其中一个节点宕机后,导致部分消费端Confluent Kafka无法消费,消费配置填写的集群IP,Confluent.Kafka版本是0.11.2,kafka集群版本是:2.12-2.3.1

日志报错还是一直去连异常的节点:

#__consumer_offsets的状态,其他topic 也都是同样的缺少node3的状态显示
Topic:__consumer_offsets    PartitionCount:50    ReplicationFactor:3    Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer
    Topic: __consumer_offsets    Partition: 0    Leader: 4    Replicas: 4,3,5    Isr: 4,5
    Topic: __consumer_offsets    Partition: 1    Leader: 5    Replicas: 5,4,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 2    Leader: 1    Replicas: 1,5,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 3    Leader: 2    Replicas: 2,1,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 4    Leader: 2    Replicas: 3,2,4    Isr: 4,2
    Topic: __consumer_offsets    Partition: 5    Leader: 4    Replicas: 4,5,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 6    Leader: 5    Replicas: 5,1,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 7    Leader: 1    Replicas: 1,2,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 8    Leader: 2    Replicas: 2,3,4    Isr: 4,2
    Topic: __consumer_offsets    Partition: 9    Leader: 4    Replicas: 3,4,5    Isr: 5,4
    Topic: __consumer_offsets    Partition: 10    Leader: 4    Replicas: 4,1,2    Isr: 4,2,1
    Topic: __consumer_offsets    Partition: 11    Leader: 5    Replicas: 5,2,3    Isr: 5,2
    Topic: __consumer_offsets    Partition: 12    Leader: 1    Replicas: 1,3,4    Isr: 4,1
    Topic: __consumer_offsets    Partition: 13    Leader: 2    Replicas: 2,4,5    Isr: 4,5,2
    Topic: __consumer_offsets    Partition: 14    Leader: 5    Replicas: 3,5,1    Isr: 5,1
    Topic: __consumer_offsets    Partition: 15    Leader: 4    Replicas: 4,2,3    Isr: 4,2
    Topic: __consumer_offsets    Partition: 16    Leader: 5    Replicas: 5,3,4    Isr: 4,5
    Topic: __consumer_offsets    Partition: 17    Leader: 1    Replicas: 1,4,5    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 18    Leader: 2    Replicas: 2,5,1    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 19    Leader: 1    Replicas: 3,1,2    Isr: 2,1
    Topic: __consumer_offsets    Partition: 20    Leader: 4    Replicas: 4,3,5    Isr: 4,5
    Topic: __consumer_offsets    Partition: 21    Leader: 5    Replicas: 5,4,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 22    Leader: 1    Replicas: 1,5,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 23    Leader: 2    Replicas: 2,1,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 24    Leader: 2    Replicas: 3,2,4    Isr: 2,4
    Topic: __consumer_offsets    Partition: 25    Leader: 4    Replicas: 4,5,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 26    Leader: 5    Replicas: 5,1,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 27    Leader: 1    Replicas: 1,2,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 28    Leader: 2    Replicas: 2,3,4    Isr: 4,2
    Topic: __consumer_offsets    Partition: 29    Leader: 4    Replicas: 3,4,5    Isr: 4,5
    Topic: __consumer_offsets    Partition: 30    Leader: 4    Replicas: 4,1,2    Isr: 4,2,1
    Topic: __consumer_offsets    Partition: 31    Leader: 5    Replicas: 5,2,3    Isr: 5,2
    Topic: __consumer_offsets    Partition: 32    Leader: 1    Replicas: 1,3,4    Isr: 4,1
    Topic: __consumer_offsets    Partition: 33    Leader: 2    Replicas: 2,4,5    Isr: 4,5,2
    Topic: __consumer_offsets    Partition: 34    Leader: 5    Replicas: 3,5,1    Isr: 5,1
    Topic: __consumer_offsets    Partition: 35    Leader: 4    Replicas: 4,2,3    Isr: 4,2
    Topic: __consumer_offsets    Partition: 36    Leader: 5    Replicas: 5,3,4    Isr: 4,5
    Topic: __consumer_offsets    Partition: 37    Leader: 1    Replicas: 1,4,5    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 38    Leader: 2    Replicas: 2,5,1    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 39    Leader: 1    Replicas: 3,1,2    Isr: 2,1
    Topic: __consumer_offsets    Partition: 40    Leader: 4    Replicas: 4,3,5    Isr: 4,5
    Topic: __consumer_offsets    Partition: 41    Leader: 5    Replicas: 5,4,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 42    Leader: 1    Replicas: 1,5,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 43    Leader: 2    Replicas: 2,1,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 44    Leader: 2    Replicas: 3,2,4    Isr: 4,2
    Topic: __consumer_offsets    Partition: 45    Leader: 4    Replicas: 4,5,1    Isr: 4,5,1
    Topic: __consumer_offsets    Partition: 46    Leader: 5    Replicas: 5,1,2    Isr: 5,2,1
    Topic: __consumer_offsets    Partition: 47    Leader: 1    Replicas: 1,2,3    Isr: 2,1
    Topic: __consumer_offsets    Partition: 48    Leader: 2    Replicas: 2,3,4    Isr: 4,2
    Topic: __consumer_offsets    Partition: 49    Leader: 4    Replicas: 3,4,5    Isr: 5,4
发表于 2022-06-06
添加评论

存储offset的topic没问题,消费者对应的topic describe一下看看,它应该不正常。

也是正常的,都是2副本的配置,案例说关机一台是没有问题 真的是想不明白那里有问题

你的答案

查看kafka相关的其他问题或提一个您自己的问题