Urgent.News

What's breaking now, across hundreds of outlets.

Tech

Investigating consumer lag without guesswork

Hi everyone, we’ve created a new project called Broka that supports Kafka, RabbitMQ, Redis, ActiveMQ Artemis, and Memcached. If you don't mind, I’d love to walk you through it with a quick guide. You can also check it out at broka.dev — would love to hear your thoughts and feedback! Let me start introduction <3 A Kafka consumer group shows a lag of 0. Is it caught up? Not necessarily. Offset lag…

A new project called Broka has been developed, which supports Kafka, RabbitMQ, Redis, ActiveMQ Artemis, and Memcached. The creators are inviting individuals to explore the project at broka.dev and provide their feedback. During their presentation, they discussed consumer lag in Kafka and explained that a lag of 0 does not necessarily mean a consumer is caught up.

They clarified that offset lag only counts the partitions a group has committed to, and a brand-new group that has never committed anything will also display a lag of 0. The difference lies in the state beside the number: if members hold assignments, it is considered stable, indicating a backlog that someone is working on. If no consumers are present, the lag will not move until a consumer joins, regardless of the size of the backlog.

Lastly, if the number is changing due to an assignment that is being rebalanced, it signifies that the group is in the process of redistributing tasks.

Rewritten by urgent.news; may contain errors — check the original.

Read the original at dev.to →

Report a problem with this story

More in Tech

OpenTelemetry-Style Spans for VIN Decode Latency and Upstream Attribution

A free VIN decode looks like one button click. Under the hood it is normalize, validate, cache lookup, optional proxy hop, NHTSA DecodeVinValues, field mapping, and render.

  • Implement OpenTelemetry-style spans for VIN decode latency.
  • Use child spans to pinpoint slow stages: normalization, cache, upstream VPIC, mapping.
  • Add hashed VIN attribute for privacy-safe identification.

Git at a hackathon: how to combine code and not lose your demo

На хакатоне Git помогает хранить общую историю проекта и соединять работу участников. Для небольшой команды достаточно простого порядка: основная ветка запускается, изменения делаются небольшими…

  • Git facilitates shared project history and combined work at hackathons
  • Establish main branch, make small changes, and review before merging
  • Use GitHub for collaboration, access control, and demo-ready versions

More from Wednesday 7 October →