Chintan

``` model=sigmareaver/flan-ul2-4bit-128g-gptq volume=$PWD/flan-ul2-4bit-128g-gptq-data docker run --gpus all --shm-size 24g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:latest --model-id $model --max-total-tokens 5024 --max-input-length 4096 --num-shard 4 --max-concurrent-requests 128 --quantize gptq ``` Output: ``` Traceback...

I faced the same issue today. It's not about wifi/hotspot. You need to use VPN. Hoping the issue will be fixed soon, meanwhile, VPN is the simplest solution.

The updated version of RandomizedSearchCV has different implementation of for looking up grid_scores' params.