The Xet storage method uses de-duplication and chunked downloads to speed up transfers in some situations: https://pypi.org/project/hf-xet/ But most importantly, installing the Xet support gets rid of some annoying HuggingFace CLI messages about missing the feature.