kafka的Java版本

半兽人 发表于: 2015-03-10   最后更新时间: 2016-04-02  
  •   40 订阅,2700 游览

Java版本


From a security perspective, we recommend you use the latest released version of JDK 1.8 as older freely available versions have disclosed security vulnerabilities. LinkedIn is currently running JDK 1.8 u5 (looking to upgrade to a newer version) with the G1 collector. If you decide to use the G1 collector (the current default) and you are still on JDK 1.7, make sure you are on u51 or newer. LinkedIn tried out u21 in testing, but they had a number of problems with the GC implementation in that version. LinkedIn's tuning looks like this:

从安全的角度来看,我们推荐你使用最新的发布版本JDK1.8,旧版本已经公开披露了安全漏洞,LinkedIn现在正在运行的是JDK 1.8 u5(希望升级到新版本)与G1收集器,如果你仍使用G1收集器(当前默认),仍然使用JDK 1.7,请确保在u51或更高的版本,LinkedIn尝试在u21测试,但是在u21版本有大量G1执行的问题。LinkedIn的配置如下:

-Xmx6g -Xms6g -XX:MetaspaceSize=96m -XX:+UseG1GC
-XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:G1HeapRegionSize=16M
-XX:MinMetaspaceFreeRatio=50 -XX:MaxMetaspaceFreeRatio=80


For reference, here are the stats on one of LinkedIn's busiest clusters (at peak): - 60 brokers - 50k partitions (replication factor 2) - 800k messages/sec in - 300 MB/sec inbound, 1 GB/sec+ outbound The tuning looks fairly aggressive, but all of the brokers in that cluster have a 90% GC pause time of about 21ms, and they're doing less than 1 young GC per second.

供参考,下面是关于 LinkedIn 的繁忙集群 (高峰) 之一的统计:- 60 brokers - 50k 分区 (副本 2) - 800k 消息/秒 在- 300 MB/sec的入站, 1 GB/秒+ 出站,这个调整看来相当激进, 但是集群中的有90%的GC暂停时间大约是21ms, 以及每秒小于1 的年轻代GC.






发表于: 1年前   最后更新时间: 9月前   游览量:2700
上一条: kafka生产服务器配置
下一条: kafka监控
评论…

  • 评论…
    • in this conversation
      提问