Skip to content

Pull requests: CarperAI/trlx

New pull request New
17 Open 283 Closed
17 Open 283 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: guard against division by zero in GPTRewardModel with empty batches
#610 opened Feb 11, 2026 by themavik Loading…
1
Fix peft import, bump dependency
#608 opened Jun 7, 2025 by amrzv Loading…
2
Faster & memory-efficient logprobs calculation
#583 opened Dec 2, 2023 by li-plus Loading…
1
update(requirements.txt): to the latest transformers & deepspeed
#579 opened Nov 6, 2023 by maxreciprocate Loading…
1
support parallel reward function
#575 opened Oct 24, 2023 by Jingru Loading…
16
feats: Add text enviroment examples
#560 opened Sep 18, 2023 by PhungVanDuy • Draft
feat: Add support for DPO
#556 opened Sep 7, 2023 by sandeepchittilla Loading…
1
13
Inference pipeline
#555 opened Sep 4, 2023 by Dahoas Loading…
1
Dist ref kl
#529 opened Jul 18, 2023 by Dahoas Loading…
1
Implement BoN for training and eval
#528 opened Jul 18, 2023 by Dahoas Loading…
15
Feature: Implementing SFT mixing with PPO
#525 opened Jul 17, 2023 by Dahoas Loading…
8-bit inference (#512)
#513 opened Jun 24, 2023 by glerzing Loading…
13
feat: support add tokens to tokenizer.
#498 opened Jun 6, 2023 by congchan Loading…
5
Add Stable Vicuna Training
#487 opened May 24, 2023 by PhungVanDuy • Draft
1
[WIP] Add Minimum Risk Trainer support
#427 opened Apr 10, 2023 by alexandremuzio • Draft
4 tasks
Use attrs/cattrs instead of custom serialization
#333 opened Feb 23, 2023 by cat-state • Draft
1
Mistobaan/add docwebsite
#274 opened Feb 3, 2023 by Mistobaan Loading…
23
ProTip! Exclude everything labeled bug with -label:bug.