Skip to content

Arm backend: Add MobileSAM Ethos-U example - #21397

Merged
usamahz merged 1 commit into
pytorch:mainfrom
usamahz:codex/mobilesam-ethosu-example-github
Jul 29, 2026
Merged

Arm backend: Add MobileSAM Ethos-U example#21397
usamahz merged 1 commit into
pytorch:mainfrom
usamahz:codex/mobilesam-ethosu-example-github

Conversation

@usamahz

@usamahz usamahz commented Jul 27, 2026

Copy link
Copy Markdown
Collaborator

Add a MobileSAM prompt segmentation example for Ethos-U85-256.

Prepare the pinned official source in an external managed checkout.

Apply a small configurable-input patch instead of copying model code.

Use int8 globally and A16W8 for TinyViT attention.

Lower the complete graph to Ethos-U and compare output with FP32.

Emit delegation summaries, validation metrics, and debug artifacts.

Build a bare-metal Corstone-320 app using exporter metadata.

Validate inference on FVP through the Arm OOTB test.

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

@pytorch-bot

pytorch-bot Bot commented Jul 27, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21397

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Unrelated Failure, 1 Unclassified Failure

As of commit 4651e01 with merge base 1f7c6d0 (image):

NEW FAILURES - The following jobs have failed:

UNCLASSIFIED FAILURE - DrCI could not classify the following job because the workflow did not run on the merge base. The failure may be pre-existing on trunk or introduced by this PR:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 27, 2026
@github-actions github-actions Bot added ciflow/trunk module: arm Issues related to arm backend labels Jul 27, 2026
@usamahz
usamahz requested review from Erik-Lundell and zingo and removed request for digantdesai, kirklandsign, larryliu0820, mergennachin and zingo July 27, 2026 13:05
@usamahz usamahz added release notes: arm Changes to the ARM backend delegate skip-url-lint labels Jul 27, 2026
@usamahz

usamahz commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot cherry-pick --onto release/1.4 -c examples

@pytorch-bot

pytorch-bot Bot commented Jul 28, 2026

Copy link
Copy Markdown

❌ 🤖 pytorchbot command failed:

@pytorchbot cherry-pick: error: argument -c/--classification: invalid choice: 'examples' (choose from 'regression', 'critical', 'fixnewfeature', 'docs', 'release')

usage: @pytorchbot cherry-pick --onto ONTO [--fixes FIXES] -c
                               {regression,critical,fixnewfeature,docs,release}

Try @pytorchbot --help for more info.

@usamahz

usamahz commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot cherry-pick --onto release/1.4 -c release

@usamahz

usamahz commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot cherry-pick --onto release/1.4 -c docs

@Sebastian-Larsson Sebastian-Larsson added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Jul 28, 2026
@usamahz

usamahz commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator Author

Dont merge, let me check something

@usamahz
usamahz marked this pull request as draft July 28, 2026 13:16
Add a MobileSAM prompt segmentation example for Ethos-U85-256.

Prepare the pinned official source in an external managed checkout.

Apply a small configurable-input patch instead of copying model code.

Use int8 globally and A16W8 for TinyViT attention.

Lower the complete graph to Ethos-U and compare output with FP32.

Emit delegation summaries, validation metrics, and debug artifacts.

Build a bare-metal Corstone-320 app using exporter metadata.

Validate inference on FVP through the Arm OOTB test.

Change-Id: Ib9b5e51aec4f324a642fbfb78316b0f4cd2f670f
Signed-off-by: Usamah Zaheer <usamah.zaheer@arm.com>
@usamahz
usamahz force-pushed the codex/mobilesam-ethosu-example-github branch from b1885f8 to 4651e01 Compare July 29, 2026 10:28
@usamahz
usamahz marked this pull request as ready for review July 29, 2026 10:31
@usamahz
usamahz merged commit 7a55e23 into pytorch:main Jul 29, 2026
500 of 507 checks passed
@usamahz

usamahz commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot cherry-pick --onto release/1.4 -c release

@pytorchbot

Copy link
Copy Markdown
Collaborator

Cherry picking #21397

The cherry pick PR is at #21460 The following tracker issues are updated:

Details for Dev Infra team Raised by workflow job

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate skip-url-lint

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants