Skip to content
This repository was archived by the owner on Nov 8, 2026. It is now read-only.

Reuse shared Store settings and configure process memory watermarks - #12

Merged
liran merged 5 commits into
mainfrom
randy/role-config-redesign
Sep 20, 2026
Merged

liran merged 5 commits into
mainfrom
randy/role-config-redesign

Conversation

@liran

@liran liran commented Sep 19, 2026 •

Copy link
Copy Markdown
Contributor

Render one shared Store ConfigMap for each Engine/Worker pair and pass it with --store-config. Shared MongoDB concurrency and Kafka source/DLQ policy update both role checksums; producer, consumer, batching and forwarding remain role-specific. All roles support process memory high/low watermarks (80/70 by default), replacing burst/wait settings and snapshot/output quotas. Update schema validation, examples, operational sizing guidance and KEDA queries for the new metrics. Companion server: batchstream/sink#112; qualification: batchstream/sink-production-suite#28.

Validated with strict Helm lint, 31 rendering tests, packaging, and parsing generated examples with the candidate executable. Chart 0.8 targets Sink 0.19.0: its default image requires that release, while an explicit candidate image supports pre-release use. It is incompatible with older images and private forwarding versions. Startup sizing checks may require larger Pod limits when transport, Lua or Kafka buffers are increased.

@liran liran changed the title Reuse shared Store files across Engine and Worker deployments Reuse shared Store settings and configure process memory watermarks Sep 19, 2026
@liran
liran marked this pull request as ready for review September 20, 2026 00:14
@liran
liran merged commit 8241f18 into main Sep 20, 2026
5 checks passed
@liran
liran deleted the randy/role-config-redesign branch September 20, 2026 00:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant