Search results

[需求] 在 AISBench 中添加自动生成指定长度数据集的能力，且有真实语义供 mtp/eagle3/Speculative Inference 特性测试

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

Status: Open.

#231 In AISBench/benchmark;

· xuchi-0808 opened on Apr 4, 2026

[Bug] 330镜像有6个多G，不符合预期

bugSomething isn't workingSomething isn't working

content_check_failedissue content check failedissue content check failed

Status: Open.

#229 In AISBench/benchmark;

· jiangyunfan1 opened on Apr 1, 2026

[Bug] longbench跑性能测试时数据翻倍了

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#227 In AISBench/benchmark;

· SJTUyh opened on Apr 1, 2026

[Bug] mmmu精度测评问题

bugSomething isn't workingSomething isn't working

content_check_failedissue content check failedissue content check failed

Status: Open.

#224 In AISBench/benchmark;

· wenba0 opened on Mar 30, 2026

[文档] 如需进一步配置、使用 CLI 或 Python 脚本发起评测任务，请参考快速入门指南。跳转错误

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#221 In AISBench/benchmark;

· Keithwwa opened on Mar 28, 2026

[Bug] longbenchv2精度测评无结果输出

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#220 In AISBench/benchmark;

· wenba0 opened on Mar 27, 2026

[Bug] 使用开源数据集sharegpt跑不起来

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#219 In AISBench/benchmark;

· zhangjiale-zjl opened on Mar 26, 2026

[疑问] 测性能缺少TPOT/ITL指标数据

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#218 In AISBench/benchmark;

· huangdong2022 opened on Mar 26, 2026

[疑问] 自定义数据集跑不起来报错

content_check_failedissue content check failedissue content check failed

questionFurther information is requestedFurther information is requested

Status: Open.

#217 In AISBench/benchmark;

· wangbairu opened on Mar 25, 2026

[Bug] Qwen3.5-35B，textVQA评测，prediction目视正常，评测分数为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#212 In AISBench/benchmark;

· YuhanBai opened on Mar 23, 2026

[需求] 希望支持aime2026数据集的精度测试

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

Status: Open.

#211 In AISBench/benchmark;

· chenweiqiang11 opened on Mar 23, 2026

[Bug] 使用自定义数据集，在模型输出正确答案的情况下，统计结果不准确

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#209 In AISBench/benchmark;

· xiaobaitu-lh opened on Mar 20, 2026