AIOS icon indicating copy to clipboard operation
AIOS copied to clipboard

torch/cuda issue

Open businistry opened this issue 10 months ago • 4 comments

Initialize AIOS powered by LLM: mixtral-8x7b-it 2024-03-29 18:52:03,062 - DEBUG - Starting new HTTPS connection (1): huggingface.co:443 2024-03-29 18:52:03,205 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 0 2024-03-29 18:52:03,206 - DEBUG - Attempting to acquire lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock 2024-03-29 18:52:03,206 - DEBUG - Lock 5751387536 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock 2024-03-29 18:52:03,300 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 720 config.json: 100%|████████████████████████████████████████████████████████████████████████| 720/720 [00:00<00:00, 676kB/s] 2024-03-29 18:52:03,327 - DEBUG - Attempting to release lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock 2024-03-29 18:52:03,327 - DEBUG - Lock 5751387536 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock 2024-03-29 18:52:03,935 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors HTTP/1.1" 404 0 2024-03-29 18:52:04,021 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 0 2024-03-29 18:52:04,024 - DEBUG - Attempting to acquire lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock 2024-03-29 18:52:04,025 - DEBUG - Lock 6052548688 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock 2024-03-29 18:52:04,124 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 92658 model.safetensors.index.json: 100%|██████████████████████████████████████████████████| 92.7k/92.7k [00:00<00:00, 2.68MB/s] 2024-03-29 18:52:04,164 - DEBUG - Attempting to release lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock 2024-03-29 18:52:04,165 - DEBUG - Lock 6052548688 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock Downloading shards: 0%| | 0/19 [00:00<?, ?it/s]2024-03-29 18:52:04,250 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00001-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:52:04,300 - DEBUG - Attempting to acquire lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock 2024-03-29 18:52:04,300 - DEBUG - Lock 6067941136 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock 2024-03-29 18:52:04,303 - DEBUG - Starting new HTTPS connection (1): cdn-lfs-us-1.huggingface.co:443 2024-03-29 18:52:04,451 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00001-of-00019.safetensors%3B+filename%3D%22model-00001-of-00019.safetensors%22%3B&Expires=1712015524&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTUyNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTQ2NjljNWFlYzI5ZmU1ZTRlZGQ4MDk4ZjdiNTY0YTEzN2JhMzZiZTIyYWQyNWExOTRjZDkzZjJiYjU0Yzk0MD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=WcDC8tmz2MnThexhaZ9FQqzk-h06B99T9UbFZeyfER1l1rSH45s9O2Rwd6jKtLZGCjYbHMAA2NPppI3NY8ystRgY9kowAsexpvtaWgik4Zxb-3hF4ql8XX0kZVjmIA-7whzWaTGHezooLge1UHF0Dnfy-A6CGPoIi69VoYrWfu2Ez5TYUJ~My8BqZ7~pP9zsTPoEzKmxGg6EYVml9oHM60qEtezYdj6kxLckHlMFVl0YUuJcJZHcnHt9u3IVf7jML4PLg2yepoy~poiaOJ8o~~9d08rGsvlD9fCYaS5VVniV6utththC8~UmjC9aXZhttuNmFiD3NJJ1OojzP6YTtg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4892809584 model-00001-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.89G/4.89G [00:53<00:00, 90.7MB/s] 2024-03-29 18:52:58,387 - DEBUG - Attempting to release lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock 2024-03-29 18:52:58,387 - DEBUG - Lock 6067941136 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock Downloading shards: 5%|███▍ | 1/19 [00:54<16:15, 54.22s/it]2024-03-29 18:52:58,502 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00002-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:52:58,507 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock 2024-03-29 18:52:58,507 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock 2024-03-29 18:52:58,614 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00002-of-00019.safetensors%3B+filename%3D%22model-00002-of-00019.safetensors%22%3B&Expires=1712014184&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDE4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjllMTUzNjRkOGFiMWQ2ZWUyMjkyMzMzODFmMjk1ZTlmZjk2MjM3ZWZlZDA0NzUwNTkxZjdkYTUyYWI2Y2MwZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=FZyz2TlKFTHzZ00vTEGByk3hlVmeGTb2DYypdSPUXRnUtB2WgV2PgihRfzC5s2IP8JlUCJqtGthMsnEFFpEEXf565-vY1TVkdCU92gF-m-nVhct8o~CAV16MeyZh81k5qaj-0GmjFiTufxTb~M-~3vx7QE0B3lJr7BHKn5TsrQTrUJmulSasajOTAwi9tj5oJn-kDoCjx8BHqCzftLDUYf9Go4C5AqqTmVIJAMhRX996Yh8EkWtPP4A6whXV0rCU34agrYsHLoR941VazyM~zhqJ99lIvCCZsZEOymiJpZjKeFQsMAZJRxLmJRH7i1fpIy8QNhnQtVMwLCBF2DvCoQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016 model-00002-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 92.7MB/s] 2024-03-29 18:53:52,392 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock 2024-03-29 18:53:52,392 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock Downloading shards: 11%|██████▉ | 2/19 [01:48<15:19, 54.09s/it]2024-03-29 18:53:52,470 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00003-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:53:52,507 - DEBUG - Attempting to acquire lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock 2024-03-29 18:53:52,508 - DEBUG - Lock 6060966672 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock 2024-03-29 18:53:52,628 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00003-of-00019.safetensors%3B+filename%3D%22model-00003-of-00019.safetensors%22%3B&Expires=1712015382&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZDBiNjNmY2E3OTNjYzI5NDIxY2M1YTQ2ODUxOTkyOTc1Y2JlMDgzYWFkZWQxYjJmMzExMTNhNDVhMGM5MDk1ND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=hY~c9-vF0tEJU9SXrGUS6OqC7GIXmsE73VRY~VLRu3lh7XmK8HwG0n7zfScS6e9dXe0u1tKad0nsg6tuvs9Qo5KnhzKE4HWLbPcunQZAHJjix9oASZhwzIHZjKJU5VxoqQ1vWVL6N6VJvlQz1kJUPmjly2MjboJ8Lyev7LEY90HvhwYH0lI~cixk5X4rHxMnpIDMrWglmziJQX2OBkizYkjuvMJnkIlzC9NIR8Kcy6AbD0wIFRDiGMpzFGICT5dFyHFcq01biBpt5iVDDDK1Rg-yGs6NheD85y3Y1w98h32jv4osRPAU4IMC~OgyhaVIk-uFLNvxtMwIgs44njhXCg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016 model-00003-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 94.1MB/s] 2024-03-29 18:54:45,572 - DEBUG - Attempting to release lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock 2024-03-29 18:54:45,572 - DEBUG - Lock 6060966672 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock Downloading shards: 16%|██████████▍ | 3/19 [02:41<14:18, 53.68s/it]2024-03-29 18:54:45,684 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00004-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:54:45,690 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock 2024-03-29 18:54:45,691 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock 2024-03-29 18:54:45,815 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00004-of-00019.safetensors%3B+filename%3D%22model-00004-of-00019.safetensors%22%3B&Expires=1712014450&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDQ1MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjdlMDU5NjkyMGZlNTQzNDE1YzAxOTFlODY3YTlhN2RlOTQyYTI5MjRkNjI3N2NkOThjOGM1YjM0ZTExZTQzNj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=j1slpxTVfiiZlkfXvqe6Dt7SVlcMMI8SL83N2yhYhbG21pH8CMh59U34-qRlqsTzsGsqz66~WbR8WFK0BHf2xXHg46GbiTfivFs5CWe6jV43N9zqDuUg7PX9LCfldIDP94GTLzbLXqJibGMb-YPLABw8rbignbpkVS5X5WM1eLVg7g9Vz0bwLEFMvoA7oEZleuv3Tb4ZCdhWR4oDkgAdXeQ6FtltndNCOl4mMDuNfE98FblEiJ1uxxIFzZd~2hpU0w3NzsZ9sJnI~fURIEspwGnBM4pMyV0NsPOVGXJZUEkNhy6llra85jGmVuw4HfMtYcwmzWSRzbqsxaxhu2B8NQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035200 model-00004-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:54<00:00, 89.7MB/s] 2024-03-29 18:55:40,417 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock 2024-03-29 18:55:40,417 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock Downloading shards: 21%|█████████████▉ | 4/19 [03:36<13:32, 54.14s/it]2024-03-29 18:55:40,526 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00005-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:55:40,581 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock 2024-03-29 18:55:40,582 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock 2024-03-29 18:55:40,674 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00005-of-00019.safetensors%3B+filename%3D%22model-00005-of-00019.safetensors%22%3B&Expires=1712014360&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDM2MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTMzMGVhYmQ3MGI0NjdkZGNiZDhkM2Q2YjJiOWMzZWJhNjY2NTViMGVkOWY4NGUxOWYyNzBkYTM2MjNkYzQ1NT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Uxyk5K9RelY2V~9NY-0I9p5tBw4HB~LLcri8bz9PNUe4YwVTBf6FRsfra5LFXWlmx2CqXTthJDfZQc7XIyY-dm6W-nj5suVOVGOiZQeitPDpLcQlgANH~c-oQ8Rn8ttYDFbJnpkGHPoYerxe48IVHDW43Jeb1vKdGt-PCVmXrV8blfpMkCdA5a~CsxU2St5lKJ3y7xE0XRADvvNbf0jp3TMPvf4lDnSRNynYWCqKyQ4-f6gx8CqcPyO7iTBpLt93DiN0yXOGeWhnh2g1a36FH6mDhj31gCq8yvqlnk3ijt9LGi5x~EWL212G25xyawHcoSL1zq7fyXJs4Ip~xBdfJA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016 model-00005-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:54<00:00, 91.4MB/s] 2024-03-29 18:56:35,213 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock 2024-03-29 18:56:35,213 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock Downloading shards: 26%|█████████████████▎ | 5/19 [04:31<12:41, 54.37s/it]2024-03-29 18:56:35,331 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00006-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:56:35,339 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock 2024-03-29 18:56:35,340 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock 2024-03-29 18:56:35,417 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00006-of-00019.safetensors%3B+filename%3D%22model-00006-of-00019.safetensors%22%3B&Expires=1712015795&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTc5NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMDQ4ZmE1MzQ3ODc3YjZkMDRlY2NmNjk3NjVkMjNlNTU2MWNjOTgyMGRkNGQwZTViYTJkZjAxMDAyMDRkZmIwND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=a7xea92d53X-M1T8Q06nnpdfE-7O4EA23Rmpcxgvd5q1cq2Vku-AueCOvA2kIUw0ZlAW5V5xurQWEZ-WaTci3XVcYxLjHA~g4uM4TLHJ8zjDHTGbUEpcTMKNcSy1QNMpyp0h3Se9OJmijT9~1ejEMFIRCAVjNqg7cGX37aOEm47VXgfLlkM7x8s84a6vlG29eyfxbLfZYyk2P52S3ObwiURxkQFlguxzsmWdZ8068KvgrAcyPwqluUkd-r4QFKF~Y1yN4FvFTYzqqkbSbJZVE1HV0q7YcRB0dHWgSseK~wQSYyfzHS56sba746K9ot3-uKdtop~-QhsxPl4JntVLcQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016 model-00006-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:51<00:00, 96.7MB/s] 2024-03-29 18:57:26,957 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock 2024-03-29 18:57:26,957 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock Downloading shards: 32%|████████████████████▊ | 6/19 [05:22<11:35, 53.48s/it]2024-03-29 18:57:27,069 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00007-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:57:27,108 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock 2024-03-29 18:57:27,109 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock 2024-03-29 18:57:27,187 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00007-of-00019.safetensors%3B+filename%3D%22model-00007-of-00019.safetensors%22%3B&Expires=1712015847&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTg0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvODNiZmVkNjE2OWMxZjViMGFlODU0ZmIzMzExYjU3NmQwNjIwOWVlNWFmNDVkN2Q0NmJjYmMyNTA5OGE0ZDAyYj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=XKritaLSbL6x3tpodntZXDMrfBLwFkDel394Ze6rttSPk-SP4EOFssY~VDcgAH1ePoht-HNcA5FYp9iUQIfLx~nykyq4AijSsXRqS20-ugtvaELPJra2NWNp0HGP6~mhv~Ywmi5jqN35f8CWmWiWSh5-AYASO-ZMNobedmp1l0zu4vTrAUuo~DoYBdrGvKDxebI1YOBWH75GeQVAyLUl~GbKbj4LHB78BrTdTLeW9BtYmRJH1xMNznbSLQo4VI3RRZAkfUxGewnG48R4qKrBuD85e0j99nMGVlCZdTH8Qx3-XLbv7rkksyRoDVPqn3re5qETPP1CBwkTUy3FXNho6g__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248 model-00007-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:50<00:00, 97.5MB/s] 2024-03-29 18:58:17,419 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock 2024-03-29 18:58:17,419 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock Downloading shards: 37%|████████████████████████▎ | 7/19 [06:13<10:29, 52.49s/it]2024-03-29 18:58:17,533 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00008-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:58:17,540 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock 2024-03-29 18:58:17,540 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock 2024-03-29 18:58:17,601 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00008-of-00019.safetensors%3B+filename%3D%22model-00008-of-00019.safetensors%22%3B&Expires=1712014682&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDY4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvYWYzMTZhZDc4NDAyN2VkYmE0N2JmMDk1OWM4MjE2ODJjOTMxYzljOTAxZDNkNzU1MDM4YjM1OGQ5YzdhMjhjMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=nJ3OFuXG03HdxwtmfcWDTihEsBHvrhWckfMI5G57RBetjkq2onR0qOGb3TDU7vJfLSTho6PRHguic5~y3zlTOHUR3iCCwGvB42WK~Bx2PgJkOYw0cnW9MTF15k95Q7mwNcSQrGLLw~ZUqlnKwgpMJ-CfdKNQfgocytAbKouzvuSPjsGgmAECODX49uuw7rEYaJBFFat0L57HJGYlvj08Ba9wJz54hWEDg2HOxZRrJZ8WzRlFCaZo36JccAnsfvqKbdR1JNcsqyTbk~5J~WhOZhnpLaXtJlK8Duf37qp~2SqxuHSEtK9aOC0jqZj7GY1JPsEutf9znTyeHqsVbyitsQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00008-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.0MB/s] 2024-03-29 18:59:10,084 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock 2024-03-29 18:59:10,084 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock Downloading shards: 42%|███████████████████████████▊ | 8/19 [07:05<09:38, 52.55s/it]2024-03-29 18:59:10,160 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00009-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 18:59:10,225 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock 2024-03-29 18:59:10,226 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock 2024-03-29 18:59:10,319 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00009-of-00019.safetensors%3B+filename%3D%22model-00009-of-00019.safetensors%22%3B&Expires=1712015584&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTg4MmU0MzY2YzYzMDQ4YTBhZDM2ZWY2ZDkwMTk0YTJmYWJkYjQyYTIxNDBiZTc5YzhlMGVjMmU4YWMyY2NjNT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Rw7BZRkOpESlfXyXAP776cJ-7QH3muQxj3sfC0CtqMXnf55ieEkhH5oFWmz1dnH9EUapxBzWssiifXeP7CwhtkzqHdHNghTictCfuy~giLQHlWQWQr5z8bG2m~x3FAT7tdMV3yK362XpU5vUnp~M5t~sBvefuQAR6cnYK5IzQecYdy9Fm3HXI6JzfHyOSzk7L3ZkJeidZVaraDcMh9alSJjFqajHiE8jopDknMH2aQ0~iCNR26Iu5CRUVc9VJfR016t1NCjP-8~DWs~jyBDZL80NZ7bt~kpWTz7A6Z1g1otcrMP1Guv945NSLfBUu3jsIuZJ399kQPxj~nTTqWOwQQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00009-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 94.2MB/s] 2024-03-29 19:00:03,210 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock 2024-03-29 19:00:03,210 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock Downloading shards: 47%|███████████████████████████████▎ | 9/19 [07:59<08:47, 52.73s/it]2024-03-29 19:00:03,314 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00010-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:00:03,320 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock 2024-03-29 19:00:03,321 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock 2024-03-29 19:00:03,380 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00010-of-00019.safetensors%3B+filename%3D%22model-00010-of-00019.safetensors%22%3B&Expires=1712015547&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzc4MTNkMWRiZWU2MzQxOTIyNmFjMTVlNGI4ZjI4ZDA3NWMzZjc5MjFjYzY2NDA5MDIzNmM0OTE2NjdlYWYyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=EOc-RybVXjM7CGdRkv6LY8bV~O1iumqpzkbOuU39AKSb0imjpTwDGqfMuh6dqBjqDp3olaZnzVm475wsXpusN3DkXScGaTy68F6WBpRkHugR--2ukZDKSiV1beyId85vhE8q1PoJGS6q5s8T~Dz4fMSaRzaq4r3K9YZkbz41qfJuCGLGjVpvrqFafffcsJgkRexODHOG9dI~a1ntQhTZXskWNLTgmwBXRMPrzwZjXZoYSBpBn6XUFu5UUDyuhiuxhVtP1t5gHMj-VN-jyvQf0gb~7gGZ4q~iamvbZOnLYsPUpNAr8v-FWMlU9Z9y~76AP7mIH~WUVkdF2yCJn8xadg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248 model-00010-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:53<00:00, 92.0MB/s] 2024-03-29 19:00:56,642 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock 2024-03-29 19:00:56,642 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock Downloading shards: 53%|██████████████████████████████████▏ | 10/19 [08:52<07:56, 52.95s/it]2024-03-29 19:00:56,740 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00011-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:00:56,783 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock 2024-03-29 19:00:56,784 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock 2024-03-29 19:00:56,839 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00011-of-00019.safetensors%3B+filename%3D%22model-00011-of-00019.safetensors%22%3B&Expires=1712016056&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjA1Nn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZmYyNDU0MGQ5OTY3ZmU0M2MwYzE3Y2FkYWVhN2YyYTM0ZDA4MGEyZjllNThiOTEzMDM4YjliZmQwYmY4Y2E0OT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=c9VF~pGafImO5QY6cqmNPMXcTi8KJTP7Ryx585frL321dQmlOxMeqYHy2MCgYCZ--g9yx105YDwOR0~G~zlr~ZteaApVJeBBDENoF3WCXOZADH0GnPzy5cGyYRLqm7FCaT4vrPGK-qERM9D5AWfsuiIvpRUXBmykIQLVqTlWG1vPxgfmEuJOMGObLgpQrYvfQcHq6APOgxx8ojm80i9h1NNkN5iV-xTf8jV6noLRlG8Jyhg5afZqI1lGO4VZA7xa6Ilnn2cX1LKkF68XVNMc-3kOuiLeC6Iwk6qjdNhelaoSgeE7~FpP6FcZen8Z~JEHb6V4DUsyGn86gTy4~tvFyA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00011-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.6MB/s] 2024-03-29 19:01:48,989 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock 2024-03-29 19:01:48,989 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock Downloading shards: 58%|█████████████████████████████████████▋ | 11/19 [09:44<07:02, 52.76s/it]2024-03-29 19:01:49,122 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00012-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:01:49,132 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock 2024-03-29 19:01:49,133 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock 2024-03-29 19:01:49,182 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00012-of-00019.safetensors%3B+filename%3D%22model-00012-of-00019.safetensors%22%3B&Expires=1712016109&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjEwOX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNDhiYzEyODQ1Njc2ZWFiMWFkYjNjZmNlNzAzN2E3ZWNkNjY0YTBkNWY1ZGVhZjkzYzczNjJhNWJiNTE3MzI5OD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=AGLeuapEY86P-Gyfd9QQlEbKSBlfgjPSyhnMh6cuDZFKqGu2Dpq2N9zKZpC4Q2RdM3oZ5jmCjFYjxCNTCSUH7Ss~L-cWCo4ZQrpjAoZN1DpCz~thlpyGjgqcBuZGfQh~cSwUrv2Ci6BUr62uE46BFmDxNGYtzLst210StfNIyNXp5enr63En5fETNjBjE1q9ES2Ik0XGp~lPncRN5UInZexUV-gQqauSIQcGQxiOf4FQ8zJAQGGsnaMAHMJJ4JqVOerBZ~mq1NXpnWoSPkFXKwWeCYfs2iKSj1gJtaoIY3yPNTtawDgMOgLQjb4IaO9Ci6y-1s6mec-bDWmghtdRTw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00012-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:55<00:00, 90.2MB/s] 2024-03-29 19:02:44,427 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock 2024-03-29 19:02:44,427 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock Downloading shards: 63%|█████████████████████████████████████████ | 12/19 [10:40<06:15, 53.58s/it]2024-03-29 19:02:44,507 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00013-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:02:44,549 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock 2024-03-29 19:02:44,550 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock 2024-03-29 19:02:44,647 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00013-of-00019.safetensors%3B+filename%3D%22model-00013-of-00019.safetensors%22%3B&Expires=1712016164&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjE2NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTU2YTJlN2VkYTY5OWJmNGVjMTQzM2JkMDdkN2NiODY0ODg0MjA4MTNlNjY0NjNkMmUyMjk2ZDdhY2NlYmM1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=RD8KjzaojJfJdyz-q~UByQwIS~MtxKQao-b34iW8-9rqE0iMzghE2qm7mr-HhqbeYOZdp0yXJUyAeujshFRGrW7L0ndZjBoM7n5sXxnlktNFsxEy2KwEE31oDnqIDZqso0d5LMBo7Mar~l999HkDYvpFyNp0TA3H1WbCe~NXdIcBpoaabjKi93T9J05nQUINmVRMVfCkfcmnZ-erdM9Q7V3V4dKSptEUIqm6IM8zWIydAxPFe4ibsrV4YXq6e9oDVW3BAn7Dcu7GJIEKL3vfPdljICifRfBPbCHyY9FVJ-KO-rMLxhR9H4csPH4WfoqCJWjHtMwyS0u~RmyK15j6AQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00013-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 92.6MB/s] 2024-03-29 19:03:38,472 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock 2024-03-29 19:03:38,472 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock Downloading shards: 68%|████████████████████████████████████████████▍ | 13/19 [11:34<05:22, 53.72s/it]2024-03-29 19:03:38,592 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00014-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:03:38,601 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock 2024-03-29 19:03:38,601 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock 2024-03-29 19:03:38,655 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00014-of-00019.safetensors%3B+filename%3D%22model-00014-of-00019.safetensors%22%3B&Expires=1712016218&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjIxOH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZGE2MjdmNmEzYzhmZGM2ZTM1Yjk5MThkMmFhNTM3MDRkNDA0NDE5MWZjYzg2YzdjMGIxYWM1N2YwMGU3MDdmNz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Et7Qgh6fwqvHjp~W~oq58bmA26296xMVU-GSZlPF4bhGzyd5XFH2EdNaMK4pPcnGkg-kA5zCCkxbToJXkWNTjE0sq1wHqtz7fOCOHbO4ZVFgEd~5gWdodd5dcmcAvKMb6RzwsFFipSE~WJFZ8un1cK6Q72-1g~Q8QnPSqJxaQ0TrT6asaRLc6dH6s74TcvfsAZnmVq9n8OQqnqrFlSoPJjrkCzE2s10oInSCQVGDiGISxSIiFaGnS4j9VtWtHUa70kwiDQiYe~aJjvvwf6TCDLyCSolPK0ZYeJGL~MBtcWpIFo7JaYhK702HdFAXYYroyM3LmaGjm6ZFc6qJnMORbA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248 model-00014-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:51<00:00, 95.7MB/s] 2024-03-29 19:04:29,876 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock 2024-03-29 19:04:29,876 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock Downloading shards: 74%|███████████████████████████████████████████████▉ | 14/19 [12:25<04:25, 53.02s/it]2024-03-29 19:04:29,960 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00015-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:04:30,002 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock 2024-03-29 19:04:30,002 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock 2024-03-29 19:04:30,060 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00015-of-00019.safetensors%3B+filename%3D%22model-00015-of-00019.safetensors%22%3B&Expires=1712016270&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjI3MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjFlMGYyMmJmZjkzYTY4ZTExNGRiYzNkNzVjMWRkMWU2Njg3ZDU1NGRiYTBjZmRmMTc0Mzk1MGFhMDRmZjFjZj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=dqk2EkzCLl1BFXFZ34XuKJsTNqvoMUZPbK~tggNgUKFanJzjgotVrBnRl8Z0zSbv71YP-PtGAZGU~EzoWwBtqOZvXg1FZPJFxnMAtgD2KiPwoZduRRHk7taI3nETayWiTjzw2qL~fCYAUGyhVXW2tHYx4WhMomCpNx2TXcatx1Om1ugAdSiX28-2pM~E-aGI2PlRqCLEq~8iF64MI3KFNdQbxMh221jylIdpRCYkIC5LtAWv0~BLGoNWT6tZ5ME6fU96lwuKRaK1g0Yz5qvNAXDK4OBI35xByEYJvy7XLCMSk6DeYUSuEA-qgl7BCRXZXMLJACa-fwVIq4akQo5BZw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00015-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 93.7MB/s] 2024-03-29 19:05:23,228 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock 2024-03-29 19:05:23,228 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock Downloading shards: 79%|███████████████████████████████████████████████████▎ | 15/19 [13:19<03:32, 53.12s/it]2024-03-29 19:05:23,329 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00016-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:05:23,338 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock 2024-03-29 19:05:23,339 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock 2024-03-29 19:05:23,437 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00016-of-00019.safetensors%3B+filename%3D%22model-00016-of-00019.safetensors%22%3B&Expires=1712015384&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzY0NjZiZmMyMzEyZjExNTU5NDgwOTgxZjIxMmU0Y2NhNmU5ODA5NmJmOGRmMGZkOTBjY2UxZjBmNDcwOWE5Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Vkz68TR-4Mh8XvS9gijXnE1zOfaR4M4f5ETHhgrB95b~jXCrGrzQtbtzmd1uZ2~Z4BiJWjXalGcazRqWGBJObSY3EwGpvdhUqWVIsfZ6inwHn7bRk7nvjhvcXXtf8aPErAd3UYIr6maB982usg6CG2WgDzL9Ea~LWCUpQaPv-SNabLuBaEKtwNuhN74F8G08du9s2zG30cNb3kkgRuFSWWPHoBe3cQvoeVUFxOB97djdIaqwCRrk~NrblzwfUhaiMT5Eu1pjYY7iQGWqsnvCLtZfaZbI3QlDKhudsIMeVd3NnPC9wtzQxToelmY4B47BSiEErkglGm0OOQqefqeqrQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00016-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:56<00:00, 88.6MB/s] 2024-03-29 19:06:19,707 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock 2024-03-29 19:06:19,707 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock Downloading shards: 84%|██████████████████████████████████████████████████████▋ | 16/19 [14:15<02:42, 54.13s/it]2024-03-29 19:06:19,780 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00017-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:06:19,824 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock 2024-03-29 19:06:19,825 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock 2024-03-29 19:06:19,877 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00017-of-00019.safetensors%3B+filename%3D%22model-00017-of-00019.safetensors%22%3B&Expires=1712016379&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjM3OX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTcwYWYzYjgwMmJlZGMwZDU0ZDA0ODFkMTI0ZjYzZDQ0OWRkYTQwYTQyOTRhODJhMzlmOGRjMzcwNDA1N2E1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=jqgkdjkjlKDEQH8xHyw53TbZgJz6av~UdZkLQV~CWFkE9TDtNncnxFj9m0D8PR~hB-Jd3fDfvgGTVBz55nvPThWwVV2KcFJgHseggVcleFGc~7OQAAwKiad9F9jyrKmgd4ErXk~qaGp8GEPqk6mOaU79pp5egpuVaO6wZIKsdIqs8WH-AY9aydNC2rs3UON3NivSaNAD1XQBeEYgvtGYW2T2f8-yByzB-n4p55QTVLN4IPIp5xfdN4DXS0xFlJwXzAjmM2k-mGkhY4iVEmt8sh90hcMPzsGkSX69WZ1qwhsWjWAlMIUjjUS-e-4bCsNeheynlvm8RRDnIpjC1w6wOQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248 model-00017-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:56<00:00, 87.3MB/s] 2024-03-29 19:07:15,993 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock 2024-03-29 19:07:15,994 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock Downloading shards: 89%|██████████████████████████████████████████████████████████▏ | 17/19 [15:11<01:49, 54.78s/it]2024-03-29 19:07:16,097 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00018-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:07:16,107 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock 2024-03-29 19:07:16,108 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock 2024-03-29 19:07:16,168 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00018-of-00019.safetensors%3B+filename%3D%22model-00018-of-00019.safetensors%22%3B&Expires=1712014985&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDk4NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNGM2MDNiNjVjYmQ1ZGRhZGNkNWVjZThhZGQ2OGI5ZDQ3Zjk4ZjcyNjRkYmIwYTUzMTMxNzJjNzg0OTFlMDMyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=ZcuF0TPS8vO9fqsPjRdeVKtyWYBG0i1Tg7W56bqLaSPBMrap2SvlHf6VbSllZi-0hVJkOtV7np6nWf9beWVmCZwSrt-94fcjooMiRFc-gColIpWU~o-R5kiZfyn8uOlezS~fmYuotqC1-uG3sIWLy2Rfc02c-9FNoMgdkYK8ZRDSYRA50FUEVxbQ8L~Av2aVJ7tkQhNex3Rsu5U~7Pq~Z1OFvvm83C66rnpOWs~EXsKSgjz6N~-ac4fBMjvEdVy4iJo4C9fNgJOScK0STjSP9T4ysRMCtT8OXn3IqHsURONVusnjY1zxAq-8MgXpye8rldkYY3KaQmNcHUfGdMMUtw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072 model-00018-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.4MB/s] 2024-03-29 19:08:08,393 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock 2024-03-29 19:08:08,393 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock Downloading shards: 95%|█████████████████████████████████████████████████████████████▌ | 18/19 [16:04<00:54, 54.06s/it]2024-03-29 19:08:08,671 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00019-of-00019.safetensors HTTP/1.1" 302 0 2024-03-29 19:08:08,714 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock 2024-03-29 19:08:08,715 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock 2024-03-29 19:08:08,788 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00019-of-00019.safetensors%3B+filename%3D%22model-00019-of-00019.safetensors%22%3B&Expires=1712016488&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjQ4OH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjcyZjMzYzc2YmNhY2Y2Y2ZjZWQ0OTdkYzA1NzllMTA3ZGUzODc0YjlmOTMxMjZmNWU2OWI1YjFhZTdlNzJhMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=MPwahSoVY8iLQNail~KD1C53T6XbyddehZFgzKUQY~lOfvQSUJFtVenc8B0p8viQqxv8pTnYu140uFG-Egip-S1uUqMYz2z0iKZi6y7wGSjbT1FOht1dW6iMelzSvpi0IHbvL3moT7UGhUIm05cBKWG6a35ly6Nm2wmprE8uFvTEHVXPAj9OPNqyAD2tpHnpkGRtCEInk~cEWr8he09cvtGs7~JsAZRKY4wUBDhIlCqZBsxzKlMhWseStRMWoCkzaRocElZXFlEuwwW1J8eixoOt6~rFPM~G~zHC7pW7~p~mVoKu6mtDnAG9vN7pgP5msrKLuIKNLx14XAiF5LnAlg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4221679088 model-00019-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.22G/4.22G [00:48<00:00, 86.5MB/s] 2024-03-29 19:08:57,625 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock 2024-03-29 19:08:57,625 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock Downloading shards: 100%|█████████████████████████████████████████████████████████████████| 19/19 [16:53<00:00, 53.34s/it] 2024-03-29 19:08:58,055 - WARNING - Device 0 is not available, available devices are [] 2024-03-29 19:08:58,055 - WARNING - Device 1 is not available, available devices are [] 2024-03-29 19:08:58,055 - WARNING - Device 2 is not available, available devices are [] 2024-03-29 19:08:58,679 - WARNING - Device 0 is not available, available devices are [] 2024-03-29 19:08:58,679 - WARNING - Device 1 is not available, available devices are [] 2024-03-29 19:08:58,679 - WARNING - Device 2 is not available, available devices are [] Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s] Traceback (most recent call last): File "/Users/toddcurry/AIOS/main.py", line 87, in main() File "/Users/toddcurry/AIOS/main.py", line 44, in main llm = llms.LLMKernel(llm_name, max_gpu_memory, max_new_tokens) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/toddcurry/AIOS/src/llms/llms.py", line 31, in init self.load_llm_and_tokenizer() File "/Users/toddcurry/AIOS/src/llms/llms.py", line 56, in load_llm_and_tokenizer self.model = model_class[self.model_type].from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 561, in from_pretrained return model_class.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3502, in from_pretrained ) = cls._load_pretrained_model( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3926, in _load_pretrained_model new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 805, in _load_state_dict_into_meta_model set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs) File "/opt/anaconda3/lib/python3.11/site-packages/accelerate/utils/modeling.py", line 387, in set_module_tensor_to_device new_value = value.to(device) ^^^^^^^^^^^^^^^^ File "/opt/anaconda3/lib/python3.11/site-packages/torch/cuda/init.py", line 293, in _lazy_init raise AssertionError("Torch not compiled with CUDA enabled") AssertionError: Torch not compiled with CUDA enabled

businistry avatar Mar 31 '24 04:03 businistry

Hi, could you provide more information about your environment like cuda version and basic procedures of how this error can be reproduced? Thanks.

dongyuanjushi avatar Mar 31 '24 15:03 dongyuanjushi

I think @businistry did not use a GPU in the first place

srivhash avatar Mar 31 '24 22:03 srivhash

This is likely true. new to this. I have a mac w/ M3 pro processor

businistry avatar Apr 01 '24 04:04 businistry

It is true @businistry Mac M3 uses metal not cuda Use colab with a T4 GPU instead

srivhash avatar Apr 01 '24 04:04 srivhash