Skip to content

feat(gateway): Set consumer group ID for kafka/confluent consume#5624

Open
lena-larionova wants to merge 1 commit into
release/gateway-3.15from
feat/kafka-consumer-group-id
Open

feat(gateway): Set consumer group ID for kafka/confluent consume#5624
lena-larionova wants to merge 1 commit into
release/gateway-3.15from
feat/kafka-consumer-group-id

Conversation

@lena-larionova

Copy link
Copy Markdown
Contributor

Description

Kafka Consume and Confluent Consume can now set a consumer group ID instead of generating one. This is necessary for brokers that enforce ACLs.

Added plugin examples; I don't think it needs a reference section, but could be convinced.

Examples for https://github.com/Kong/kong-technical-enablement/tree/main/api-gateway/3.15/kafka-consume-consumer-group-id.

Preview Links

@lena-larionova lena-larionova added this to the Gateway 3.15 milestone Jun 18, 2026
@lena-larionova lena-larionova requested a review from a team as a code owner June 18, 2026 05:42
Copilot AI review requested due to automatic review settings June 18, 2026 05:42
@netlify

netlify Bot commented Jun 18, 2026

Copy link
Copy Markdown

Deploy Preview for kongdeveloper ready!

Name Link
🔨 Latest commit 6b0e80d
🔍 Latest deploy log https://app.netlify.com/projects/kongdeveloper/deploys/6a33854367f7820008008d7d
😎 Deploy Preview https://deploy-preview-5624--kongdeveloper.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
🤖 Make changes Run an agent on this branch

To edit notification comments on pull requests, go to your Netlify project configuration.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds new plugin example configurations for Kafka Consume and Confluent Consume that demonstrate setting a stable consumer group ID (either manually or derived from an authenticated Kong Gateway Consumer), supporting Kafka brokers/managed services that enforce consumer-group ACLs.

Changes:

  • Added a Kafka Consume example for a fixed (operator-chosen) consumer group ID (manual mode).
  • Added a Kafka Consume example that sets consumer group ID based on the authenticated Consumer (kong_consumer mode).
  • Added equivalent examples for Confluent Consume, including required Confluent Cloud credentials.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
app/_kong_plugins/kafka-consume/examples/consumer-group-manual.yaml New example showing a fixed, manually specified consumer group ID for ACL-enforced clusters.
app/_kong_plugins/kafka-consume/examples/consumer-group-kong-consumer.yaml New example showing consumer-group derivation from the authenticated Kong Gateway Consumer.
app/_kong_plugins/confluent-consume/examples/consumer-group-manual.yaml New Confluent Cloud variant of the fixed/manual consumer group ID example (includes API key/secret).
app/_kong_plugins/confluent-consume/examples/consumer-group-kong-consumer.yaml New Confluent Cloud variant of the per-Consumer consumer group ID example (includes API key/secret).

@tomek-labuk tomek-labuk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just a side note: should we rethink our convention of how we frame requirements (instead of 'You have x y z' just state 'x y z' directly)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants