kafka集群崩溃,报错Caused by: java.io.IOException: No space left on device

kafka 0.10.1.0版本,3个节点,我在运行了一段时间后,有个节点自己关闭了。
这是错误报文:

kafka.common.KafkaStorageException: I/O exception in append to log 'logs-normal-0'
        at kafka.log.Log.append(Log.scala:349)
        at kafka.cluster.Partition$$anonfun$10.apply(Partition.scala:443)
        at kafka.cluster.Partition$$anonfun$10.apply(Partition.scala:429)
        at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:234)
        at kafka.utils.CoreUtils$.inReadLock(CoreUtils.scala:240)
        at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:429)
        at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:407)
        at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:393)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
        at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
        at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
        at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
        at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.AbstractTraversable.map(Traversable.scala:104)
        at kafka.server.ReplicaManager.appendToLocalLog(ReplicaManager.scala:393)
        at kafka.server.ReplicaManager.appendMessages(ReplicaManager.scala:330)
        at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:425)
        at kafka.server.KafkaApis.handle(KafkaApis.scala:78)
        at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:60)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: No space left on device
        at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
        at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
        at sun.nio.ch.IOUtil.write(IOUtil.java:65)
        at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
        at kafka.message.ByteBufferMessageSet.writeFullyTo(ByteBufferMessageSet.scala:304)
        at kafka.log.FileMessageSet.append(FileMessageSet.scala:354)
        at kafka.log.LogSegment.append(LogSegment.scala:97)
        at kafka.log.Log.append(Log.scala:409)
        ... 22 more

请问这是什么错误。






发表于: 1年前   最后更新时间: 1年前   游览量:3443
上一条: 请教kafka配额管理的问题
下一条: kafka进程还在,但是该broker对应的机器没有流量出入。此时要如何处理?

评论…


  • 您这个问题 怎么处理的呢 我也遇到了这个问题,, broker down 机 一周 在启动就报错了
    查看下崩溃机器的磁盘空间,没有可用的空间了
  • 评论…
    • in this conversation