First, clone this repository to your local machine, and install the dependencies (torch, torchvision, numpy, Pillow, and huggingface_hub). git clone git@github.com ...
Example code to load pre-quantized models: Pre-quantized models can be found here: https://huggingface.co/collections/Disty0/sdnq Safetensors serialization is not ...