stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

very slow download speeds from drive.yerf.org in a google colab notebook

Open EntityinArray opened this issue 3 years ago • 6 comments

Describe the bug In StableDiffusionIO-Voldemort V1.2 google colab notebook, there is a code-block that downloads stable diffusion checkpoint file from drive.yerf.org Download speed is ~1 MB/s, which takes ~2 hours to download 4GB model.

To Reproduce Steps to reproduce the behavior:

  1. Go to StableDiffusionUI-Voldemort V1.2
  2. Execute all code blocks in order
  3. When executing penultimate code block, it will stuck in a very long download at speeds of 1 MB/s

Expected behavior Faster download speeds

Screenshots image

Desktop (please complete the following information):

  • OS: Linux Fedora Workstation 36
  • Browser Google Chrome Version 106.0.5249.91 (Official Build) (64-bit)

EntityinArray avatar Oct 01 '22 19:10 EntityinArray

Change line 17 in \stable-diffusion-webui\modules\sd_models.py

model_url = "https://drive.yerf.org/wl/?id=EBfTrmcCCUAGaQBXVIj5lJmEhjoP1tgl&mode=grid&download=1"

It downloads from this furry site by default. IDK why. Here are some alternative hosting locations you can download from. ** Web Archived reddit post since it was deleted *** https://cc.bingj.com/cache.aspx?q=url%3ahttps%3a%2f%2fteddit.net%2fr%2fStableDiffusion%2fcomments%2fwv4sqt%2fcheckpoint_v14_mirror_no_huggingface_account%2f&d=4520028031615380&mkt=en-US&setlang=en-US&w=Wzm4mF5OqTIHeIuYGV_p6j3YU3IUnVK4

https://gofile.io/d/PrbUge https://pixeldrain.com/u/yD33e2mE https://ipfs.io/ipfs/bafybeicrdgunwfjxm5yr7qqe5kgybaog65wnonymaeumzkto4eagrvwz2a https://bafybeicrdgunwfjxm5yr7qqe5kgybaog65wnonymaeumzkto4eagrvwz2a.ipfs.dweb.link/ https://cloudflare-ipfs.com/ipfs/bafybeicrdgunwfjxm5yr7qqe5kgybaog65wnonymaeumzkto4eagrvwz2a https://gateway.pinata.cloud/ipfs/bafybeicrdgunwfjxm5yr7qqe5kgybaog65wnonymaeumzkto4eagrvwz2a

magnet:?xt=urn:btih:3a4a612d75ed088ea542acac52f9f45987488d1c&dn=sd-v1-4.ckpt&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337

magnet:?xt=urn:btih:15443640dc68faed53ac3c6b1cfd6bf335adaa74&dn=stable-diffusion-v1.4-and-license.zip&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A6969%2Fannounce

dovezp avatar Oct 01 '22 20:10 dovezp

Moreover, I assume the download is unnecessary. I'm pretty sure I have the sd 1.4 checkpoint, but somehow after update it started to redownload it from the slow site...

sliedes avatar Oct 01 '22 22:10 sliedes

Moreover, I assume the download is unnecessary. I'm pretty sure I have the sd 1.4 checkpoint, but somehow after update it started to redownload it from the slow site...

For me is the same, sd 1.4 checkpoint is on my mounted google drive, it seems it cannot be copied on the right path.

pourquoipas avatar Oct 02 '22 13:10 pourquoipas

That "drive" is limited to 1mb/sec per connection. Though you can also just parallelize the download, you'll get 24+mb/sec with 32 connections

cmp-nct avatar Oct 02 '22 15:10 cmp-nct

I feel like the notebook should just be versioned in this repo. This way there's more transparency and we all have one source of truth. It seems incredibly strange for this user to have swapped out the "official" source for seemingly no reason at all

ghost avatar Oct 02 '22 17:10 ghost

Do you guys need a fast download server? I can hook you up with some pixeldrain credit. That way you can serve the model directly from pixeldrain without running into data caps or any other limits.

Fornax96 avatar Oct 18 '22 12:10 Fornax96