Kafak 自动Shutdown completed ??

sunney 发表于: 2016-07-15   最后更新时间: 2016-07-15 16:25:47   7,821 游览

我有两台机,每个各两个Brokers,但其中一机启动1-2天自动Shutdown completed
这台主挂了,有没有谁有遇到这个问题呢???


错误日志:

 WARN [ReplicaFetcherThread-0-13], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@6fc6b4a3. Possible cause: java.io.IOException: Connection to 13 was disconnected before the response was read (kafka.server.ReplicaFetcherThread)

详细日志下如:


[2016-07-14 18:03:00,584] INFO [Group Metadata Manager on Broker 14]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2016-07-14 18:05:54,253] INFO [Kafka Server 14], shutting down (kafka.server.KafkaServer)
[2016-07-14 18:05:54,257] INFO [Kafka Server 14], Starting controlled shutdown (kafka.server.KafkaServer)
[2016-07-14 18:05:54,309] INFO [Kafka Server 14], Controlled shutdown succeeded (kafka.server.KafkaServer)
[2016-07-14 18:05:54,313] WARN [ReplicaFetcherThread-0-13], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@6fc6b4a3. Possible cause: java.io.IOException: Connection to 13 was disconnected before the response was read (kafka.server.ReplicaFetcherThread)
[2016-07-14 18:05:54,316] INFO [Socket Server on Broker 14], Shutting down (kafka.network.SocketServer)
[2016-07-14 18:05:54,323] INFO [Socket Server on Broker 14], Shutdown completed (kafka.network.SocketServer)
[2016-07-14 18:05:54,323] INFO [Kafka Request Handler on Broker 14], shutting down (kafka.server.KafkaRequestHandlerPool)
[2016-07-14 18:05:54,325] INFO [Kafka Request Handler on Broker 14], shut down completely (kafka.server.KafkaRequestHandlerPool)
[2016-07-14 18:05:54,327] INFO [ThrottledRequestReaper-Produce], Shutting down (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:54,524] INFO [ThrottledRequestReaper-Produce], Stopped  (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:54,524] INFO [ThrottledRequestReaper-Produce], Shutdown completed (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:54,524] INFO [ThrottledRequestReaper-Fetch], Shutting down (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:55,524] INFO [ThrottledRequestReaper-Fetch], Stopped  (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:55,524] INFO [ThrottledRequestReaper-Fetch], Shutdown completed (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-07-14 18:05:55,524] INFO [KafkaApi-14] Shutdown complete. (kafka.server.KafkaApis)
[2016-07-14 18:05:55,526] INFO [Replica Manager on Broker 14]: Shutting down (kafka.server.ReplicaManager)
[2016-07-14 18:05:55,526] INFO [ReplicaFetcherManager on broker 14] shutting down (kafka.server.ReplicaFetcherManager)
[2016-07-14 18:05:55,527] INFO [ReplicaFetcherThread-0-13], Shutting down (kafka.server.ReplicaFetcherThread)
[2016-07-14 18:05:55,527] INFO [ReplicaFetcherThread-0-13], Stopped  (kafka.server.ReplicaFetcherThread)
[2016-07-14 18:05:55,527] INFO [ReplicaFetcherThread-0-13], Shutdown completed (kafka.server.ReplicaFetcherThread)
[2016-07-14 18:05:55,530] INFO [ReplicaFetcherManager on broker 14] shutdown completed (kafka.server.ReplicaFetcherManager)
[2016-07-14 18:05:55,530] INFO [ExpirationReaper-14], Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,706] INFO [ExpirationReaper-14], Stopped  (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,706] INFO [ExpirationReaper-14], Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,706] INFO [ExpirationReaper-14], Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,906] INFO [ExpirationReaper-14], Stopped  (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,906] INFO [ExpirationReaper-14], Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,907] INFO [Replica Manager on Broker 14]: Shut down completely (kafka.server.ReplicaManager)
[2016-07-14 18:05:55,908] INFO Shutting down. (kafka.log.LogManager)
[2016-07-14 18:05:55,934] INFO Shutdown complete. (kafka.log.LogManager)
[2016-07-14 18:05:55,935] INFO [GroupCoordinator 14]: Shutting down. (kafka.coordinator.GroupCoordinator)
[2016-07-14 18:05:55,935] INFO [ExpirationReaper-14], Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,985] INFO [ExpirationReaper-14], Stopped  (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,985] INFO [ExpirationReaper-14], Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:55,985] INFO [ExpirationReaper-14], Shutting down (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:56,186] INFO [ExpirationReaper-14], Stopped  (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:56,186] INFO [ExpirationReaper-14], Shutdown completed (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-07-14 18:05:56,186] INFO [GroupCoordinator 14]: Shutdown complete. (kafka.coordinator.GroupCoordinator)
[2016-07-14 18:05:56,193] INFO [Kafka Server 14], shut down completed (kafka.server.KafkaServer)

发表于 2016-07-15
添加评论

网络问题,关注一下防火墙,如果一个长连接长时间不使用的话,会被系统kill的。

sunney -> 小蕊 7年前

ZK与KAFKA的防火墙都是清空状态的。Brokers 13、14是在同一台机上的。是一起挂的。

小蕊 -> sunney 7年前

是不是你启动的方式不对啊?是守护进程的方式吗?

sunney -> 小蕊 7年前

nohup bin/kafka-server-start.sh config/server.properties >/dev/null 2>&1 &  启动方法

小蕊 -> sunney 7年前

自动关闭,我只知道这一个原因导致的,你上面那个是某个集群挂了之后的告警,并不是导致关闭的原因。
你看看还有别的错误日志不

小蕊 -> sunney 7年前

看看13的日志。

你的答案

查看kafka相关的其他问题或提一个您自己的问题