遇到一个5节点的集群,其中一个节点宕机后,导致部分消费端Confluent Kafka无法消费,消费配置填写的集群IP,Confluent.Kafka版本是0.11.2,kafka集群版本是:2.12-2.3.1
日志报错还是一直去连异常的节点:
#__consumer_offsets的状态,其他topic 也都是同样的缺少node3的状态显示
Topic:__consumer_offsets PartitionCount:50 ReplicationFactor:3 Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer
Topic: __consumer_offsets Partition: 0 Leader: 4 Replicas: 4,3,5 Isr: 4,5
Topic: __consumer_offsets Partition: 1 Leader: 5 Replicas: 5,4,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 2 Leader: 1 Replicas: 1,5,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 3 Leader: 2 Replicas: 2,1,3 Isr: 2,1
Topic: __consumer_offsets Partition: 4 Leader: 2 Replicas: 3,2,4 Isr: 4,2
Topic: __consumer_offsets Partition: 5 Leader: 4 Replicas: 4,5,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 6 Leader: 5 Replicas: 5,1,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 7 Leader: 1 Replicas: 1,2,3 Isr: 2,1
Topic: __consumer_offsets Partition: 8 Leader: 2 Replicas: 2,3,4 Isr: 4,2
Topic: __consumer_offsets Partition: 9 Leader: 4 Replicas: 3,4,5 Isr: 5,4
Topic: __consumer_offsets Partition: 10 Leader: 4 Replicas: 4,1,2 Isr: 4,2,1
Topic: __consumer_offsets Partition: 11 Leader: 5 Replicas: 5,2,3 Isr: 5,2
Topic: __consumer_offsets Partition: 12 Leader: 1 Replicas: 1,3,4 Isr: 4,1
Topic: __consumer_offsets Partition: 13 Leader: 2 Replicas: 2,4,5 Isr: 4,5,2
Topic: __consumer_offsets Partition: 14 Leader: 5 Replicas: 3,5,1 Isr: 5,1
Topic: __consumer_offsets Partition: 15 Leader: 4 Replicas: 4,2,3 Isr: 4,2
Topic: __consumer_offsets Partition: 16 Leader: 5 Replicas: 5,3,4 Isr: 4,5
Topic: __consumer_offsets Partition: 17 Leader: 1 Replicas: 1,4,5 Isr: 4,5,1
Topic: __consumer_offsets Partition: 18 Leader: 2 Replicas: 2,5,1 Isr: 5,2,1
Topic: __consumer_offsets Partition: 19 Leader: 1 Replicas: 3,1,2 Isr: 2,1
Topic: __consumer_offsets Partition: 20 Leader: 4 Replicas: 4,3,5 Isr: 4,5
Topic: __consumer_offsets Partition: 21 Leader: 5 Replicas: 5,4,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 22 Leader: 1 Replicas: 1,5,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 23 Leader: 2 Replicas: 2,1,3 Isr: 2,1
Topic: __consumer_offsets Partition: 24 Leader: 2 Replicas: 3,2,4 Isr: 2,4
Topic: __consumer_offsets Partition: 25 Leader: 4 Replicas: 4,5,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 26 Leader: 5 Replicas: 5,1,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 27 Leader: 1 Replicas: 1,2,3 Isr: 2,1
Topic: __consumer_offsets Partition: 28 Leader: 2 Replicas: 2,3,4 Isr: 4,2
Topic: __consumer_offsets Partition: 29 Leader: 4 Replicas: 3,4,5 Isr: 4,5
Topic: __consumer_offsets Partition: 30 Leader: 4 Replicas: 4,1,2 Isr: 4,2,1
Topic: __consumer_offsets Partition: 31 Leader: 5 Replicas: 5,2,3 Isr: 5,2
Topic: __consumer_offsets Partition: 32 Leader: 1 Replicas: 1,3,4 Isr: 4,1
Topic: __consumer_offsets Partition: 33 Leader: 2 Replicas: 2,4,5 Isr: 4,5,2
Topic: __consumer_offsets Partition: 34 Leader: 5 Replicas: 3,5,1 Isr: 5,1
Topic: __consumer_offsets Partition: 35 Leader: 4 Replicas: 4,2,3 Isr: 4,2
Topic: __consumer_offsets Partition: 36 Leader: 5 Replicas: 5,3,4 Isr: 4,5
Topic: __consumer_offsets Partition: 37 Leader: 1 Replicas: 1,4,5 Isr: 4,5,1
Topic: __consumer_offsets Partition: 38 Leader: 2 Replicas: 2,5,1 Isr: 5,2,1
Topic: __consumer_offsets Partition: 39 Leader: 1 Replicas: 3,1,2 Isr: 2,1
Topic: __consumer_offsets Partition: 40 Leader: 4 Replicas: 4,3,5 Isr: 4,5
Topic: __consumer_offsets Partition: 41 Leader: 5 Replicas: 5,4,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 42 Leader: 1 Replicas: 1,5,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 43 Leader: 2 Replicas: 2,1,3 Isr: 2,1
Topic: __consumer_offsets Partition: 44 Leader: 2 Replicas: 3,2,4 Isr: 4,2
Topic: __consumer_offsets Partition: 45 Leader: 4 Replicas: 4,5,1 Isr: 4,5,1
Topic: __consumer_offsets Partition: 46 Leader: 5 Replicas: 5,1,2 Isr: 5,2,1
Topic: __consumer_offsets Partition: 47 Leader: 1 Replicas: 1,2,3 Isr: 2,1
Topic: __consumer_offsets Partition: 48 Leader: 2 Replicas: 2,3,4 Isr: 4,2
Topic: __consumer_offsets Partition: 49 Leader: 4 Replicas: 3,4,5 Isr: 5,4
存储offset的topic没问题,消费者对应的topic describe一下看看,它应该不正常。
也是正常的,都是2副本的配置,案例说关机一台是没有问题 真的是想不明白那里有问题
你的答案