Skip to content

DataLoader加载数据集时遇到:AttributeError: '_MultiProcessingDataLoaderIter' object has no attribute '_in_order' #103

@Persistence2021

Description

@Persistence2021

环境信息

Image

CANN版本:8.5.0

报错日志

Traceback (most recent call last):
  File "/home/BiRefNet/vision_npu_infer_dataloader.py", line 162, in <module>
    main(args)
  File "/home/BiRefNet/vision_npu_infer_dataloader.py", line 135, in main
    inference(
  File "/home/BiRefNet/vision_npu_infer_dataloader.py", line 29, in inference
    warmup_batch = next(iter(data_loader_test))
                        ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torch_npu/profiler/_add_mstx_patch.py", line 23, in _custom_dataloader_iter
    out_iter = original_iter(self)
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 494, in __iter__
    return self._get_iterator()
           ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torchvision_npu/utils/_dataloader.py", line 60, in _get_iterator
    return _MultiProcessingDataLoaderIter(self)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torchvision_npu/utils/_dataloader.py", line 207, in __init__
    self._reset(loader, first_iter=True)
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 1270, in _reset
    self._try_put_index()
  File "/usr/local/python3.11.13/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 1529, in _try_put_index
    if self._in_order:
       ^^^^^^^^^^^^^^
AttributeError: '_MultiProcessingDataLoaderIter' object has no attribute '_in_order'

已经确定Torch版本自2.6.0开始新增_in_order且Torch代码正常执行,但torch_npu转换后出现该报错。具体定位请参考该issue求助可行的解决方案

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions