Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
37 Open 916 Closed
37 Open 916 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Add support for Ref-L4_test benchmark
#1525 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for RefCOCO-M benchmark
#1524 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for PixmoPoints benchmark
#1523 opened Apr 22, 2026 by rshube Loading…
[Benchmark] Add support for PixmoCount benchmark
#1522 opened Apr 22, 2026 by rshube Loading…
feat: add LiteLLM as unified AI gateway provider
#1521 opened Apr 22, 2026 by RheagalFire Loading…
1
[Model] Add nanoVLM support (nanoVLM-460M-8k, nanoVLM-230M-8k)
#1520 opened Apr 22, 2026 by khurramHashmi Loading…
[Model] Add Solari: SmolVLM2-500M fine-tuned with QLoRA DPO on RLAIF-V
#1518 opened Apr 20, 2026 by Moya-Fried-Rice Loading…
[Benchmark] Add MDPBench
#1517 opened Apr 18, 2026 by Delores-Lin Loading…
2
[Fix] Add a dedicated HLE dataset for text-only samples
#1515 opened Apr 16, 2026 by TianhaoLiang2000 Contributor Loading…
Feat/concurrent dispatch
#1514 opened Apr 15, 2026 by Bluear7878 Loading…
Add LICA-Bench dataset (graphic design VLM evaluation)
#1513 opened Apr 15, 2026 by purvanshi Loading…
1 task
1
[Benchmark] Add Support for LVOmniBench
#1510 opened Apr 9, 2026 by KD-TAO Loading…
fix(docs): fix broken anchor links in zh-CN and ja README navigation
#1507 opened Apr 3, 2026 by qyangcv Loading…
3
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1504 opened Apr 2, 2026 by inigopm Contributor Loading…
1
[Benchmark] Add support for MaXM
#1505 opened Apr 2, 2026 by inigopm Contributor Loading…
[Benchmark] Fix problems found in XSTest, M3oralbench, MSSBench, MMSafetyBench, Flames and SIUO_GEN.
#1503 opened Apr 1, 2026 by Gugugugugutian Contributor Loading…
[Fix] fix MathCanvas-Bench md5 & summarize_mathcanvas_results
#1502 opened Mar 31, 2026 by shiwk24 Contributor Loading…
3
add Ming-flash-omni-2.0
#1501 opened Mar 30, 2026 by OMRailgun Contributor Loading…
fix the vladbench download bug
#1497 opened Mar 25, 2026 by Depth2World Contributor Loading…
2
[Benchmark] Add MMRarebench dataset support
#1495 opened Mar 23, 2026 by junzhin Loading…
1
[Benchmark] Add support for MedQ-DEG-Bench
#1482 opened Mar 16, 2026 by liujiyaoFDU Contributor Loading…
2
[Model] Support for llava hf
#1479 opened Mar 11, 2026 by smgjch Loading…
2
[API] Add DeepOCR pipeline API provider
#1473 opened Mar 4, 2026 by leejooan Loading…
3
jt video chat v260227
#1460 opened Feb 28, 2026 by jiutiancv Contributor Loading…
1
Fix LLaVA model output issues by using official conversation templates WIP
#1424 opened Feb 2, 2026 by cdllI Loading…
3
ProTip! Type g i on any issue or pull request to go back to the issue listing page.