Add support for excluding specific files

[jeroenkroese]

I've created this PR because I didn't want the *.msgpack files to be downloaded, found here for example: https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/tree/main/text_encoder