A collection of helpful python scripts to automate various PyTorch activities.
A Trainer class that trains models and keeps track of various statistics.
- Response Based Distiller: A distill class that performs the response based distillation method given a teacher and a student model.