JOSS: Batched detection

[mhubii]

When running Detection -> Detect, would it be possible to support batched inference? Detection each image individually seems rather slow. Let me know

Refers openjournals/joss-reviews#5986

[dmitrypuzyrev]

I have investigated this possibility. Unfortunately it does not look easy to do, as our Detectron2 models for detection are exported via tracing (https://detectron2.readthedocs.io/en/latest/tutorials/deployment.html), which does not support dynamic batch size.

Changing this would require more work but could be one of the improvements for the future versions. At the moment, the detection speed is not a bottleneck of the 3D tracking tasks which are performed by the package.

[mhubii]

okay that's unfortunate but I understand