袁江镇

0 声望

这家伙太懒,什么都没留下

个人动态
  • 408097591 回复 袁江镇kafka第一条记录消费不到, 接下来的消息能够正常消费到。 中 :

    auto.offset.reset 如果KafkaConsumer没有初始化的offset的话,就会采用这个策略,默认是latest,这样的话就会忽略第一条KafkaProducer生产的消息。

    你把auto.offset.reset改成latest,或许能解决你的问题

    4年前
  • 袁江镇 回复 袁江镇kafka第一条记录消费不到, 接下来的消息能够正常消费到。 中 :
    [2019-09-11 06:05:06.087][main][INFO ][AbstractCoordinator 677] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Discovered group coordinator 192.168.31.14:9092 (id: 2147482641 rack: null)
    [2019-09-11 06:05:06.094][main][INFO ][ConsumerCoordinator 472] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Revoking previously assigned partitions []
    [2019-09-11 06:05:06.094][main][INFO ][AbstractCoordinator 509] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] (Re-)joining group
    [2019-09-11 06:05:07.017][main][INFO ][RCStep 239] - records.count=0
    [2019-09-11 06:05:07.018][main][DEBUG][BasicUtil 17] - took 1006ms.
    [2019-09-11 06:05:07.018][main][DEBUG][RCStep 235] - start polling ...
    [2019-09-11 06:05:08.020][main][INFO ][RCStep 239] - records.count=0
    [2019-09-11 06:05:08.020][main][DEBUG][BasicUtil 17] - took 2008ms.
    [2019-09-11 06:05:08.020][main][DEBUG][RCStep 235] - start polling ...
    [2019-09-11 06:05:09.022][main][INFO ][RCStep 239] - records.count=0
    [2019-09-11 06:05:09.022][main][DEBUG][BasicUtil 17] - took 3010ms.
    [2019-09-11 06:05:09.022][main][DEBUG][RCStep 235] - start polling ...
    [2019-09-11 06:05:09.148][main][INFO ][AbstractCoordinator 473] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Successfully joined group with generation 1
    [2019-09-11 06:05:09.149][main][INFO ][ConsumerCoordinator 280] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Setting newly assigned partitions [CVC.TELEMATICS.RESPONSE.V1.AppMocker001-8, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-9, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-6, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-7, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-10, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-11, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-0, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-1, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-4, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-5, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-2, CVC.TELEMATICS.RESPONSE.V1.AppMocker001-3]
    [2019-09-11 06:05:09.186][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-8 to offset 0.
    [2019-09-11 06:05:09.186][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-9 to offset 0.
    [2019-09-11 06:05:09.186][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-6 to offset 0.
    [2019-09-11 06:05:09.186][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-7 to offset 0.
    [2019-09-11 06:05:09.186][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-10 to offset 0.
    [2019-09-11 06:05:09.187][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-11 to offset 0.
    [2019-09-11 06:05:09.187][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-0 to offset 0.
    [2019-09-11 06:05:09.188][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-1 to offset 0.
    [2019-09-11 06:05:09.188][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-4 to offset 0.
    [2019-09-11 06:05:09.188][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-5 to offset 0.
    [2019-09-11 06:05:09.188][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-2 to offset 0.
    [2019-09-11 06:05:09.188][main][INFO ][Fetcher 601] - [Consumer clientId=consumer-1, groupId=telematics-ft-rc] Resetting offset for partition CVC.TELEMATICS.RESPONSE.V1.AppMocker001-3 to offset 22.
    [2019-09-11 06:05:10.023][main][INFO ][RCStep 239] - records.count=0
    [2019-09-11 06:05:10.023][main][DEBUG][BasicUtil 17] - took 4011ms.
    [2019-09-11 06:05:10.023][main][DEBUG][RCStep 235] - start polling ...
    [2019-09-11 06:05:11.025][main][INFO ][RCStep 239] - records.count=0
    [2019-09-11 06:05:11.025][main][DEBUG][BasicUtil 17] - took 5013ms.
    [2019-09-11 06:05:11.025][main][DEBUG][RCStep 235] - start polling ...
    
    4年前
  • 袁江镇 回复 半兽人kafka第一条记录消费不到, 接下来的消息能够正常消费到。 中 :

    都Fetch到offset了, 为啥就poll不到数据?

    4年前
  • 半兽人 回复 袁江镇kafka第一条记录消费不到, 接下来的消息能够正常消费到。 中 :

    你的问题我都看乱了。
    这个不该是consumer先已经join进去了,为什么还会 rejoined group。

    4年前