Repository navigation

fix: load padding tokens serialized as AddedToken objects - #800

Open

WitBlue6 wants to merge 3 commits into

qdrant:mainfrom

WitBlue6:fix/added-token-padding-config

Open

fix: load padding tokens serialized as AddedToken objects#800
WitBlue6 wants to merge 3 commits into
qdrant:mainfrom
WitBlue6:fix/added-token-padding-config

Commits on Oct 10, 2026
- fix: load padding tokens serialized as AddedToken objects
  WitBlue6
  committed
  02f516f
- test: document tokenizer padding regression cases
  WitBlue6
  committed
  2e4a104
Commits on Oct 11, 2026
- test: assert serialized padding metadata and document tokenizer loading
  WitBlue6
  committed
  567c60d