logit-distillation

Here are 4 public repositories matching this topic...

ZaberKo / GDKD

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for CNN image classification. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks imagenet image-classification transfer-learning knowledge-distillation model-compression cifar-100 tnnls dkd logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

sarimahsan / distillation-hiddenstates-code

Star

This repository provides an end-to-end pipeline for Knowledge Distillation (KD) of Large Language Models

research hidden-states kl-divergence llm qwen logit-distillation

Updated Jul 4, 2026
Python

ZaberKo / vit-gdkd

Star

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for ViT image classification. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks imagenet image-classification vit knowledge-distillation model-compression tnnls dkd vision-transformer logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

ZaberKo / seg-gdkd

Star

Official PyTorch implementation of GDKD (IEEE TNNLS 2026) for semantic segmentation on Cityscapes. Rethinking Decoupled Knowledge Distillation from a Predictive Distribution Perspective.

machine-learning computer-vision deep-learning pytorch neural-networks semantic-segmentation knowledge-distillation cityscapes model-compression pspnet deeplabv3 tnnls dkd logit-distillation gdkd decoupled-knowledge-distillation

Updated Sep 14, 2026
Python

Add this topic to your repo

To associate your repository with the logit-distillation topic, visit your repo's landing page and select "manage topics."

Learn more