海

0 声望

这家伙太懒，什么都没留下

个人动态
  • 半兽人 回复 海 在 kafka集群一个节点故障导致数据丢失 中 ：

    如果消息到kafka了，按照你这个，就不对丢了，你的思路没错。

    5年前
  • 海 回复 半兽人 在 kafka集群一个节点故障导致数据丢失 中 ：

    都试过，还是会丢，生产者是flume，今天我再测试下单节点flume和单节点kafka，看下是不是flume这块传输的时候丢失的

    5年前
  • 半兽人 回复 海 在 kafka集群一个节点故障导致数据丢失 中 ：

    没问题，你停掉其他的broker试试。看看是都丢，还是某台会丢。

    5年前
  • 海 在 kafka集群一个节点故障导致数据丢失 发表评论：

    你好，topic副本数为2，具体如下 

    ./kafka-topics.sh --zookeeper localhost:11001 --describe --topic dipsms
Topic:dipsms    PartitionCount:40    ReplicationFactor:2    Configs:min.insync.replicas=2
    Topic: dipsms    Partition: 0    Leader: 3    Replicas: 3,1    Isr: 1,3
    Topic: dipsms    Partition: 1    Leader: 1    Replicas: 1,2    Isr: 2,1
    Topic: dipsms    Partition: 2    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 3    Leader: 3    Replicas: 3,2    Isr: 2,3
    Topic: dipsms    Partition: 4    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 5    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 6    Leader: 3    Replicas: 3,1    Isr: 1,3
    Topic: dipsms    Partition: 7    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 8    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 9    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 10    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 11    Leader: 3    Replicas: 3,1    Isr: 3,1
    Topic: dipsms    Partition: 12    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 13    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 14    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 15    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 16    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 17    Leader: 3    Replicas: 3,1    Isr: 3,1
    Topic: dipsms    Partition: 18    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 19    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 20    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 21    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 22    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 23    Leader: 3    Replicas: 3,1    Isr: 3,1
    Topic: dipsms    Partition: 24    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 25    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 26    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 27    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 28    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 29    Leader: 3    Replicas: 3,1    Isr: 3,1
    Topic: dipsms    Partition: 30    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 31    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 32    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 33    Leader: 1    Replicas: 1,2    Isr: 1,2
    Topic: dipsms    Partition: 34    Leader: 2    Replicas: 2,3    Isr: 2,3
    Topic: dipsms    Partition: 35    Leader: 3    Replicas: 3,1    Isr: 3,1
    Topic: dipsms    Partition: 36    Leader: 1    Replicas: 1,3    Isr: 1,3
    Topic: dipsms    Partition: 37    Leader: 2    Replicas: 2,1    Isr: 2,1
    Topic: dipsms    Partition: 38    Leader: 3    Replicas: 3,2    Isr: 3,2
    Topic: dipsms    Partition: 39    Leader: 1    Replicas: 1,2    Isr: 1,2
    5年前
  • 发表了 kafka集群一个节点故障导致数据丢失  
    5年前