Skip to content

MobileBERT with SQUAD 1.1 Quantized INT8 Error #3

Closed

Description

@RiponHan

I download the quantize-aware training int8 model(saved_model.pb) from repo google-research/google-research.And I use run_squad.py which offered in the repo with tensorflow 1.15. https://github.com/google-research/google-research/tree/master/mobilebert/run_squad.py.I also try to convert this model with tensorflow 2.2/2.3/2.5/2.6/2.8-nightly.But it didn't work anymore.
You mention about that:

The TensorFlow Lite models are:
quant.tflite - Quantized (int8, per-channel) .tflite model.
quant_nnapi.tflite - Quantized (int8, per-channel) .tflite model with several mathematically equivalent op replacements for NNAPI compatibility.

So I was thinking how do you convert the model to mobilebert_int8_384.tflite and mobilebert_int8_384_nnapi.tflite?
Could you please provide some information to help convert the model?

Activity

  1. freedomtan commented on Apr 14, 2026

    @freedomtan
    Contributor

    they are kinda hacks provided by Google folks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions