Skip to content

Add image segmentation support to GUI#609

Open
tejasstanley wants to merge 15 commits into
JdeRobot:masterfrom
tejasstanley:feat/GUI_visual_detection
Open

Add image segmentation support to GUI#609
tejasstanley wants to merge 15 commits into
JdeRobot:masterfrom
tejasstanley:feat/GUI_visual_detection

Conversation

@tejasstanley

Copy link
Copy Markdown
Collaborator

This PR extends the GUI structure to support image segmentation alongside the existing image detection flow.
Changes include:

  • Adds task-specific image segmentation sidebar, dataset viewer, inference, and evaluator tabs.
  • Adds Cityscapes support for the image segmentation GUI.
  • Adds shared GUI utilities under tabs/tasks/utils.py.
  • Moves browse helpers out of perceptionmetrics/utils/gui.py.
  • Uses TorchImageSegmentationModel for segmentation inference and evaluation.
  • Adds live evaluation progress callbacks for segmentation evaluation.

@tejasstanley
tejasstanley marked this pull request as ready for review July 6, 2026 14:20
Comment thread tabs/tasks/image_segmentation/dataset_viewer.py Outdated
Comment thread tabs/tasks/image_segmentation/evaluator.py Outdated
Comment thread tabs/tasks/image_segmentation/sidebar.py
Comment thread tabs/tasks/image_segmentation/dataset_viewer.py Outdated
Comment thread app.py
"Task",
["Image Detection", "Image Segmentation", "Lidar Segmentation"],
key="task",
help="Image segmentation is currently a placeholder.",

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image segmentation is not a placeholder anymore

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a couple of regressions here due to some recent changes in object detection pre/post-processing. Namely, the min_value in the max. detections widget, the option for Max Side in the resizing strategy and the logic for retrieving padding info (you can check it out and compare against https://github.com/JdeRobot/PerceptionMetrics/blob/master/app.py)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants