Skip to content

docs: document message queue backends - #1009

Merged
edenreich merged 1 commit into
mainfrom
docs/issue-1007-20261013-1553
Oct 13, 2026
Merged

edenreich merged 1 commit into
mainfrom
docs/issue-1007-20261013-1553

Conversation

@inference-gateway-maintainer

Copy link
Copy Markdown
Contributor

Summary

Mirrors the CLI-side message queue docs into the docs site. Following the repo convention that CLI features are sections of cli.md rather than new cli-*.md pages, this adds a ### Message Queue section under Advanced Features, next to Conversation Management.

What it covers:

  • Backend table: memory (default), sqlite, postgres, redis, which ones survive a restart or can be shared, and the storage.<type> block each reuses
  • Configuration reference for queue.type, queue.name, queue.poll_interval with the INFER_QUEUE_TYPE / INFER_QUEUE_NAME / INFER_QUEUE_POLL_INTERVAL overrides, plus the same three in the Essential Environment Variables block and a pointer from Key Configuration Areas
  • Semantics: FIFO per scope, atomic drain, at-most-once delivery, startup failure on an unreachable backend, and the chat.status_bar.indicators.queue indicator
  • External producers: the JSON record format, the infer:queue:<name> Redis list with an RPUSH example, and the message_queue table with an INSERT example and the DELETE ... RETURNING / FOR UPDATE SKIP LOCKED drain
  • Cross-link from the Conversation Management storage backends list, so the queue is discoverable from the storage area

Source of truth is the CLI repo's docs/message-queue.md.

Not included: there is no infer operators / distributed deployment page in this repo (operator.md is the gateway's Kubernetes operator), so the "share one queue across processes, feed it from external producers" story lives in the new section instead of a separate operators page.

Validated with bun run lint:md, bun run format:check and bun run build.

Closes #1007

Generated with Claude Code

Co-authored-by: Eden Reich <16985712+edenreich@users.noreply.github.com>
@inference-gateway-releaser

inference-gateway-releaser Bot commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

🗑️ Preview environment destroyed.

@edenreich
edenreich merged commit 68b6d5e into main Oct 13, 2026
8 checks passed
@edenreich
edenreich deleted the docs/issue-1007-20261013-1553 branch October 13, 2026 17:54
@edenreich edenreich moved this from Todo to Done in 2026 Oct 14, 2026
inference-gateway-releaser Bot added a commit that referenced this pull request Oct 19, 2026
## [0.9.22](0.9.21...0.9.22) (2026-10-19)

### 📚 Documentation

* **a2a:** document per-agent credentials in the CLI ([#987](#987)) ([f61efae](f61efae))
* **a2a:** document token_file, token_command and oidc scopes ([#993](#993)) ([8c41cf2](8c41cf2))
* add llms.txt index for LLM crawlers ([#984](#984)) ([f3f3331](f3f3331))
* add simulate_tool_call to the mock-agent tool surface ([#1003](#1003)) ([f199416](f199416))
* **adk:** document typed A2A client errors ([#990](#990)) ([089ab08](089ab08))
* **cli:** document session working time indicator ([#986](#986)) ([2839b2b](2839b2b))
* **cli:** re-record the subagents demo on v0.227.0 ([#994](#994)) ([c53a8bf](c53a8bf))
* desktop first-run init and silent windows spawns ([#1016](#1016)) ([a893347](a893347))
* document chat.suggestions next-step suggestions ([#1006](#1006)) ([9992201](9992201))
* document message queue backends ([#1009](#1009)) ([68b6d5e](68b6d5e))
* document the daemon-hosted A2A server ([#1014](#1014)) ([27fe040](27fe040))
* drop /install-opentask for the opentask skill ([#1013](#1013)) ([372f56d](372f56d))
* drop removed CLIENT_TIMEOUT, fix two descriptions ([#998](#998)) ([9f90854](9f90854))
* fix contradicting artifact pull-back note ([#1004](#1004)) ([edcf4e4](edcf4e4))
* scope the source label claim to gen_ai and gateway series ([#997](#997)) ([36a214e](36a214e))

### 🔧 Miscellaneous

* **deps-dev:** bump the bun group with 2 updates ([#1002](#1002)) ([f7c0c5a](f7c0c5a))
* **deps-dev:** bump the bun group with 4 updates ([#1011](#1011)) ([b52e290](b52e290))
* **deps:** bump actions/create-github-app-token ([#1010](#1010)) ([c465a28](c465a28))
* **deps:** bump actions/setup-node ([#1001](#1001)) ([c0dcf1d](c0dcf1d))
* **deps:** bump claude-code 2.1.285 -> 2.1.289 ([#988](#988)) ([9f5b494](9f5b494))
* **deps:** bump infer CLI v0.221.1 -> v0.226.0 ([#991](#991)) ([844cd4f](844cd4f))
@inference-gateway-releaser

Copy link
Copy Markdown
Contributor

🎉 This PR is included in version 0.9.22 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

[DOCS] Message queue backends (memory, sqlite, postgres, redis)

1 participant