Skip to content

[Desktop] weights failed to load: occamy-1.0 NVFP4 #550

Description

@MaxManMax482

Before you start

  • I have checked the supported models and this checkpoint is not listed there. A listed checkpoint that fails is a bug; use a Bug report instead.
  • I have read the Roadmap and this model is not already planned there.
  • I have read the FAQ.
  • I have searched existing issues and found no duplicate.
  • This is not a GGUF checkpoint. GGUF support is on the Roadmap; please do not open an issue for it.

Hugging Face link

https://huggingface.co/Accio-Lab/occamy-1.0-NVFP4

Is the model architecture already supported

Yes, but this checkpoint or quantization does not load

Is the quantization already supported

Yes, but this checkpoint's weight format does not load

What happens when you load it

>>>>>>>> PASTE THE FULL SERVER LOG HERE <<<<<<<<
(copied with the "Copy server log" button in the failure dialog, or Logs -> Server status -> Copy)

WeightLoadError: ValueError: model.layers.0.mlp.gate.weight is torch.bfloat16 but the checkpoint's quant config declares model.layers.0.mlp.gate QuantScheme(nvfp4, WeightDesc(elem='e2m1', group=(1, 16

Anything else

Desktop 0.2.0-beta.22; engine 0.1.3+gc8ed699cb; NVIDIA GeForce RTX 5080, 15.9 GiB, driver 610.74; 13th Gen Intel Core i7-13700KF, 31.8 GiB

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions