Skip to content

[FROZEN][Bridge] Kept every read cache in one byte-bounded BatchCache. - #297

Closed
moetemp wants to merge 14 commits into
moe/bridge/v3/N1-stream-service-genfrom
moe/bridge/v3/N2-one-read-cache
Closed

moetemp wants to merge 14 commits into
moe/bridge/v3/N1-stream-service-genfrom
moe/bridge/v3/N2-one-read-cache

Conversation

@moetemp

@moetemp moetemp commented Oct 18, 2026

Copy link
Copy Markdown
Owner

What changed?

This PR keeps every read cache in one BatchCache of bytes with a byte bound, and deletes ByteCache.

Why?

The follow cache had a count bound only, so a few large batches could hold a lot of memory.

How did you test it?

Link to a test plan if any -

  • Unit Tests
  • Staging
  • End to End Tests

@moetemp moetemp changed the title [Bridge] Kept every read cache in one byte-bounded BatchCache. [FROZEN][Bridge] Kept every read cache in one byte-bounded BatchCache. Oct 20, 2026
@moetemp

moetemp commented Oct 22, 2026

Copy link
Copy Markdown
Owner Author

Closed as unused. Jetty and Bridge are frozen, and the Brook v4 stack doesn't build on this PR. The branch stays, so this PR can be reopened.

@moetemp moetemp closed this Oct 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant