[FROZEN][Bridge] Kept every read cache in one byte-bounded BatchCache. - #297

[FROZEN][Bridge] Kept every read cache in one byte-bounded BatchCache.#297

moetemp wants to merge 14 commits into

moe/bridge/v3/N1-stream-service-genmoetemp/sdk-python:moe/bridge/v3/N1-stream-service-genfrom

moe/bridge/v3/N2-one-read-cachemoetemp/sdk-python:moe/bridge/v3/N2-one-read-cacheCopy head branch name to clipboard