监控Kafka出现java.lang.Thread.State: BLOCKED

小头針╮︶♡ 发表于: 2020-03-23   最后更新时间: 2020-03-23  

Kafka遇到的阻塞问题

之前用Jconsole监控生产环境kafka,出现了如下的阻塞问题,只知道是0.10.1.0这个版本存在问题,但是不知道这个阻塞是什么意思?所以有知道的大佬抽空给解析一下,咱也学习学习。

下面dump文件的一部分,若需要更过也可以提供。

"executor-Rebalance" - Thread t@57057
   java.lang.Thread.State: BLOCKED
        at kafka.server.DelayedOperationPurgatory$Watchers.tryCompleteWatched(DelayedOperation.scala:308)
        - waiting to lock <39b5bc1> (a java.util.LinkedList) owned by "kafka-request-handler-1" t@71
        at kafka.server.DelayedOperationPurgatory.checkAndComplete(DelayedOperation.scala:234)
        at kafka.server.ReplicaManager.tryCompleteDelayedProduce(ReplicaManager.scala:199)
        at kafka.cluster.Partition.tryCompleteDelayedRequests(Partition.scala:374)
        at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:457)
        at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:407)
        at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:393)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.AbstractTraversable.map(Traversable.scala:104)
        at kafka.server.ReplicaManager.appendToLocalLog(ReplicaManager.scala:393)
        at kafka.server.ReplicaManager.appendMessages(ReplicaManager.scala:330)
        at kafka.coordinator.GroupMetadataManager.store(GroupMetadataManager.scala:251)
        at kafka.coordinator.GroupCoordinator$$anonfun$onCompleteJoin$6.apply(GroupCoordinator.scala:726)
        at kafka.coordinator.GroupCoordinator$$anonfun$onCompleteJoin$6.apply(GroupCoordinator.scala:726)
        at scala.Option.foreach(Option.scala:257)
        at kafka.coordinator.GroupCoordinator.onCompleteJoin(GroupCoordinator.scala:726)
        at kafka.coordinator.DelayedJoin.onComplete(DelayedJoin.scala:39)
        at kafka.server.DelayedOperation.forceComplete(DelayedOperation.scala:70)
        at kafka.server.DelayedOperation.run(DelayedOperation.scala:106)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
        - locked <3e92b205> (a java.util.concurrent.ThreadPoolExecutor$Worker)


您需要解锁本帖隐藏内容请: 点击这里
本帖隐藏的内容




上一条: kafka集群每隔30多天的时候就会有副本被踢出ISR
下一条: kafka每天消费都会有剩余数据即LAG不是0