distill — Model Optimizer 0.27.1 (original) (raw)
Modules
| modelopt.torch.distill.config | Configurations for distillation modes. |
|---|---|
| modelopt.torch.distill.distillation | API for converting a model into a modelopt.torch.distill.DistillationModel to be used directly in training. |
| modelopt.torch.distill.distillation_model | Meta-model wrapper to support knowledge-distillation learning. |
| modelopt.torch.distill.loss_balancers | Basic loss balancers for Distillation task. |
| modelopt.torch.distill.losses | Different types of distillation losses. |
| modelopt.torch.distill.mode | Module implementing and describing modes that can be used during the NAS convert process. |
| modelopt.torch.distill.plugins | Handles distillation plugins for third-party modules. |
| modelopt.torch.distill.registry | A dynamic module registry that holds information about available DynamicModules for Distillation-related purposes. |
Distillation API subpackage for torch.