Initialize AIOS powered by LLM: mixtral-8x7b-it
2024-03-29 18:52:03,062 - DEBUG - Starting new HTTPS connection (1): huggingface.co:443
2024-03-29 18:52:03,205 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 0
2024-03-29 18:52:03,206 - DEBUG - Attempting to acquire lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,206 - DEBUG - Lock 5751387536 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,300 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 720
config.json: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 720/720 [00:00<00:00, 676kB/s]
2024-03-29 18:52:03,327 - DEBUG - Attempting to release lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,327 - DEBUG - Lock 5751387536 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,935 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors HTTP/1.1" 404 0
2024-03-29 18:52:04,021 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 0
2024-03-29 18:52:04,024 - DEBUG - Attempting to acquire lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,025 - DEBUG - Lock 6052548688 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,124 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 92658
model.safetensors.index.json: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 92.7k/92.7k [00:00<00:00, 2.68MB/s]
2024-03-29 18:52:04,164 - DEBUG - Attempting to release lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,165 - DEBUG - Lock 6052548688 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
Downloading shards: 0%| | 0/19 [00:00<?, ?it/s]2024-03-29 18:52:04,250 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00001-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:52:04,300 - DEBUG - Attempting to acquire lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:04,300 - DEBUG - Lock 6067941136 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:04,303 - DEBUG - Starting new HTTPS connection (1): cdn-lfs-us-1.huggingface.co:443
2024-03-29 18:52:04,451 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00001-of-00019.safetensors%3B+filename%3D%22model-00001-of-00019.safetensors%22%3B&Expires=1712015524&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTUyNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTQ2NjljNWFlYzI5ZmU1ZTRlZGQ4MDk4ZjdiNTY0YTEzN2JhMzZiZTIyYWQyNWExOTRjZDkzZjJiYjU0Yzk0MD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=WcDC8tmz2MnThexhaZ9FQqzk-h06B99T9UbFZeyfER1l1rSH45s9O2Rwd6jKtLZGCjYbHMAA2NPppI3NY8ystRgY9kowAsexpvtaWgik4Zxb-3hF4ql8XX0kZVjmIA-7whzWaTGHezooLge1UHF0Dnfy-A6CGPoIi69VoYrWfu2Ez5TYUJMy8BqZ7pP9zsTPoEzKmxGg6EYVml9oHM60qEtezYdj6kxLckHlMFVl0YUuJcJZHcnHt9u3IVf7jML4PLg2yepoypoiaOJ8o~~9d08rGsvlD9fCYaS5VVniV6utththC8UmjC9aXZhttuNmFiD3NJJ1OojzP6YTtg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4892809584
model-00001-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.89G/4.89G [00:53<00:00, 90.7MB/s]
2024-03-29 18:52:58,387 - DEBUG - Attempting to release lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:58,387 - DEBUG - Lock 6067941136 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
Downloading shards: 5%|โโโโ | 1/19 [00:54<16:15, 54.22s/it]2024-03-29 18:52:58,502 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00002-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:52:58,507 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:52:58,507 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:52:58,614 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00002-of-00019.safetensors%3B+filename%3D%22model-00002-of-00019.safetensors%22%3B&Expires=1712014184&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDE4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjllMTUzNjRkOGFiMWQ2ZWUyMjkyMzMzODFmMjk1ZTlmZjk2MjM3ZWZlZDA0NzUwNTkxZjdkYTUyYWI2Y2MwZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=FZyz2TlKFTHzZ00vTEGByk3hlVmeGTb2DYypdSPUXRnUtB2WgV2PgihRfzC5s2IP8JlUCJqtGthMsnEFFpEEXf565-vY1TVkdCU92gF-m-nVhct8oCAV16MeyZh81k5qaj-0GmjFiTufxTbM-3vx7QE0B3lJr7BHKn5TsrQTrUJmulSasajOTAwi9tj5oJn-kDoCjx8BHqCzftLDUYf9Go4C5AqqTmVIJAMhRX996Yh8EkWtPP4A6whXV0rCU34agrYsHLoR941VazyMzhqJ99lIvCCZsZEOymiJpZjKeFQsMAZJRxLmJRH7i1fpIy8QNhnQtVMwLCBF2DvCoQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00002-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:53<00:00, 92.7MB/s]
2024-03-29 18:53:52,392 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:53:52,392 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
Downloading shards: 11%|โโโโโโโ | 2/19 [01:48<15:19, 54.09s/it]2024-03-29 18:53:52,470 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00003-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:53:52,507 - DEBUG - Attempting to acquire lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:53:52,508 - DEBUG - Lock 6060966672 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:53:52,628 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00003-of-00019.safetensors%3B+filename%3D%22model-00003-of-00019.safetensors%22%3B&Expires=1712015382&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZDBiNjNmY2E3OTNjYzI5NDIxY2M1YTQ2ODUxOTkyOTc1Y2JlMDgzYWFkZWQxYjJmMzExMTNhNDVhMGM5MDk1ND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=hYc9-vF0tEJU9SXrGUS6OqC7GIXmsE73VRYVLRu3lh7XmK8HwG0n7zfScS6e9dXe0u1tKad0nsg6tuvs9Qo5KnhzKE4HWLbPcunQZAHJjix9oASZhwzIHZjKJU5VxoqQ1vWVL6N6VJvlQz1kJUPmjly2MjboJ8Lyev7LEY90HvhwYH0lIcixk5X4rHxMnpIDMrWglmziJQX2OBkizYkjuvMJnkIlzC9NIR8Kcy6AbD0wIFRDiGMpzFGICT5dFyHFcq01biBpt5iVDDDK1Rg-yGs6NheD85y3Y1w98h32jv4osRPAU4IMCOgyhaVIk-uFLNvxtMwIgs44njhXCg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00003-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:52<00:00, 94.1MB/s]
2024-03-29 18:54:45,572 - DEBUG - Attempting to release lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:54:45,572 - DEBUG - Lock 6060966672 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
Downloading shards: 16%|โโโโโโโโโโโ | 3/19 [02:41<14:18, 53.68s/it]2024-03-29 18:54:45,684 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00004-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:54:45,690 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:54:45,691 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:54:45,815 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00004-of-00019.safetensors%3B+filename%3D%22model-00004-of-00019.safetensors%22%3B&Expires=1712014450&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDQ1MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjdlMDU5NjkyMGZlNTQzNDE1YzAxOTFlODY3YTlhN2RlOTQyYTI5MjRkNjI3N2NkOThjOGM1YjM0ZTExZTQzNj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=j1slpxTVfiiZlkfXvqe6Dt7SVlcMMI8SL83N2yhYhbG21pH8CMh59U34-qRlqsTzsGsqz66WbR8WFK0BHf2xXHg46GbiTfivFs5CWe6jV43N9zqDuUg7PX9LCfldIDP94GTLzbLXqJibGMb-YPLABw8rbignbpkVS5X5WM1eLVg7g9Vz0bwLEFMvoA7oEZleuv3Tb4ZCdhWR4oDkgAdXeQ6FtltndNCOl4mMDuNfE98FblEiJ1uxxIFzZd2hpU0w3NzsZ9sJnIfURIEspwGnBM4pMyV0NsPOVGXJZUEkNhy6llra85jGmVuw4HfMtYcwmzWSRzbqsxaxhu2B8NQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035200
model-00004-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.90G/4.90G [00:54<00:00, 89.7MB/s]
2024-03-29 18:55:40,417 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:55:40,417 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
Downloading shards: 21%|โโโโโโโโโโโโโโ | 4/19 [03:36<13:32, 54.14s/it]2024-03-29 18:55:40,526 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00005-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:55:40,581 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:55:40,582 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:55:40,674 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00005-of-00019.safetensors%3B+filename%3D%22model-00005-of-00019.safetensors%22%3B&Expires=1712014360&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDM2MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTMzMGVhYmQ3MGI0NjdkZGNiZDhkM2Q2YjJiOWMzZWJhNjY2NTViMGVkOWY4NGUxOWYyNzBkYTM2MjNkYzQ1NT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Uxyk5K9RelY2V9NY-0I9p5tBw4HBLLcri8bz9PNUe4YwVTBf6FRsfra5LFXWlmx2CqXTthJDfZQc7XIyY-dm6W-nj5suVOVGOiZQeitPDpLcQlgANHc-oQ8Rn8ttYDFbJnpkGHPoYerxe48IVHDW43Jeb1vKdGt-PCVmXrV8blfpMkCdA5aCsxU2St5lKJ3y7xE0XRADvvNbf0jp3TMPvf4lDnSRNynYWCqKyQ4-f6gx8CqcPyO7iTBpLt93DiN0yXOGeWhnh2g1a36FH6mDhj31gCq8yvqlnk3ijt9LGi5xEWL212G25xyawHcoSL1zq7fyXJs4IpxBdfJA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00005-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:54<00:00, 91.4MB/s]
2024-03-29 18:56:35,213 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:56:35,213 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
Downloading shards: 26%|โโโโโโโโโโโโโโโโโโ | 5/19 [04:31<12:41, 54.37s/it]2024-03-29 18:56:35,331 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00006-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:56:35,339 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:56:35,340 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:56:35,417 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00006-of-00019.safetensors%3B+filename%3D%22model-00006-of-00019.safetensors%22%3B&Expires=1712015795&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTc5NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMDQ4ZmE1MzQ3ODc3YjZkMDRlY2NmNjk3NjVkMjNlNTU2MWNjOTgyMGRkNGQwZTViYTJkZjAxMDAyMDRkZmIwND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=a7xea92d53X-M1T8Q06nnpdfE-7O4EA23Rmpcxgvd5q1cq2Vku-AueCOvA2kIUw0ZlAW5V5xurQWEZ-WaTci3XVcYxLjHAg4uM4TLHJ8zjDHTGbUEpcTMKNcSy1QNMpyp0h3Se9OJmijT91ejEMFIRCAVjNqg7cGX37aOEm47VXgfLlkM7x8s84a6vlG29eyfxbLfZYyk2P52S3ObwiURxkQFlguxzsmWdZ8068KvgrAcyPwqluUkd-r4QFKFY1yN4FvFTYzqqkbSbJZVE1HV0q7YcRB0dHWgSseKwQSYyfzHS56sba746K9ot3-uKdtop-QhsxPl4JntVLcQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00006-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:51<00:00, 96.7MB/s]
2024-03-29 18:57:26,957 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:57:26,957 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
Downloading shards: 32%|โโโโโโโโโโโโโโโโโโโโโ | 6/19 [05:22<11:35, 53.48s/it]2024-03-29 18:57:27,069 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00007-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:57:27,108 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:57:27,109 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:57:27,187 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00007-of-00019.safetensors%3B+filename%3D%22model-00007-of-00019.safetensors%22%3B&Expires=1712015847&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTg0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvODNiZmVkNjE2OWMxZjViMGFlODU0ZmIzMzExYjU3NmQwNjIwOWVlNWFmNDVkN2Q0NmJjYmMyNTA5OGE0ZDAyYj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=XKritaLSbL6x3tpodntZXDMrfBLwFkDel394Ze6rttSPk-SP4EOFssYVDcgAH1ePoht-HNcA5FYp9iUQIfLxnykyq4AijSsXRqS20-ugtvaELPJra2NWNp0HGP6mhvYwmi5jqN35f8CWmWiWSh5-AYASO-ZMNobedmp1l0zu4vTrAUuoDoYBdrGvKDxebI1YOBWH75GeQVAyLUlGbKbj4LHB78BrTdTLeW9BtYmRJH1xMNznbSLQo4VI3RRZAkfUxGewnG48R4qKrBuD85e0j99nMGVlCZdTH8Qx3-XLbv7rkksyRoDVPqn3re5qETPP1CBwkTUy3FXNho6g__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00007-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.90G/4.90G [00:50<00:00, 97.5MB/s]
2024-03-29 18:58:17,419 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:58:17,419 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
Downloading shards: 37%|โโโโโโโโโโโโโโโโโโโโโโโโโ | 7/19 [06:13<10:29, 52.49s/it]2024-03-29 18:58:17,533 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00008-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:58:17,540 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:58:17,540 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:58:17,601 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00008-of-00019.safetensors%3B+filename%3D%22model-00008-of-00019.safetensors%22%3B&Expires=1712014682&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDY4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvYWYzMTZhZDc4NDAyN2VkYmE0N2JmMDk1OWM4MjE2ODJjOTMxYzljOTAxZDNkNzU1MDM4YjM1OGQ5YzdhMjhjMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=nJ3OFuXG03HdxwtmfcWDTihEsBHvrhWckfMI5G57RBetjkq2onR0qOGb3TDU7vJfLSTho6PRHguic5y3zlTOHUR3iCCwGvB42WKBx2PgJkOYw0cnW9MTF15k95Q7mwNcSQrGLLwZUqlnKwgpMJ-CfdKNQfgocytAbKouzvuSPjsGgmAECODX49uuw7rEYaJBFFat0L57HJGYlvj08Ba9wJz54hWEDg2HOxZRrJZ8WzRlFCaZo36JccAnsfvqKbdR1JNcsqyTbk5JWhOZhnpLaXtJlK8Duf37qp2SqxuHSEtK9aOC0jqZj7GY1JPsEutf9znTyeHqsVbyitsQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00008-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:52<00:00, 95.0MB/s]
2024-03-29 18:59:10,084 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:59:10,084 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
Downloading shards: 42%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 8/19 [07:05<09:38, 52.55s/it]2024-03-29 18:59:10,160 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00009-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:59:10,225 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 18:59:10,226 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 18:59:10,319 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00009-of-00019.safetensors%3B+filename%3D%22model-00009-of-00019.safetensors%22%3B&Expires=1712015584&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTg4MmU0MzY2YzYzMDQ4YTBhZDM2ZWY2ZDkwMTk0YTJmYWJkYjQyYTIxNDBiZTc5YzhlMGVjMmU4YWMyY2NjNT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Rw7BZRkOpESlfXyXAP776cJ-7QH3muQxj3sfC0CtqMXnf55ieEkhH5oFWmz1dnH9EUapxBzWssiifXeP7CwhtkzqHdHNghTictCfuygiLQHlWQWQr5z8bG2mx3FAT7tdMV3yK362XpU5vUnpM5tsBvefuQAR6cnYK5IzQecYdy9Fm3HXI6JzfHyOSzk7L3ZkJeidZVaraDcMh9alSJjFqajHiE8jopDknMH2aQ0iCNR26Iu5CRUVc9VJfR016t1NCjP-8DWsjyBDZL80NZ7btkpWTz7A6Z1g1otcrMP1Guv945NSLfBUu3jsIuZJ399kQPxjnTTqWOwQQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00009-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:52<00:00, 94.2MB/s]
2024-03-29 19:00:03,210 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 19:00:03,210 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
Downloading shards: 47%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 9/19 [07:59<08:47, 52.73s/it]2024-03-29 19:00:03,314 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00010-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:00:03,320 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:03,321 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:03,380 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00010-of-00019.safetensors%3B+filename%3D%22model-00010-of-00019.safetensors%22%3B&Expires=1712015547&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzc4MTNkMWRiZWU2MzQxOTIyNmFjMTVlNGI4ZjI4ZDA3NWMzZjc5MjFjYzY2NDA5MDIzNmM0OTE2NjdlYWYyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=EOc-RybVXjM7CGdRkv6LY8bVO1iumqpzkbOuU39AKSb0imjpTwDGqfMuh6dqBjqDp3olaZnzVm475wsXpusN3DkXScGaTy68F6WBpRkHugR--2ukZDKSiV1beyId85vhE8q1PoJGS6q5s8TDz4fMSaRzaq4r3K9YZkbz41qfJuCGLGjVpvrqFafffcsJgkRexODHOG9dIa1ntQhTZXskWNLTgmwBXRMPrzwZjXZoYSBpBn6XUFu5UUDyuhiuxhVtP1t5gHMj-VN-jyvQf0gb7gGZ4qiamvbZOnLYsPUpNAr8v-FWMlU9Z9y76AP7mIHWUVkdF2yCJn8xadg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00010-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.90G/4.90G [00:53<00:00, 92.0MB/s]
2024-03-29 19:00:56,642 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:56,642 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
Downloading shards: 53%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 10/19 [08:52<07:56, 52.95s/it]2024-03-29 19:00:56,740 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00011-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:00:56,783 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:00:56,784 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:00:56,839 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00011-of-00019.safetensors%3B+filename%3D%22model-00011-of-00019.safetensors%22%3B&Expires=1712016056&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjA1Nn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZmYyNDU0MGQ5OTY3ZmU0M2MwYzE3Y2FkYWVhN2YyYTM0ZDA4MGEyZjllNThiOTEzMDM4YjliZmQwYmY4Y2E0OT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=c9VFpGafImO5QY6cqmNPMXcTi8KJTP7Ryx585frL321dQmlOxMeqYHy2MCgYCZ--g9yx105YDwOR0GzlrZteaApVJeBBDENoF3WCXOZADH0GnPzy5cGyYRLqm7FCaT4vrPGK-qERM9D5AWfsuiIvpRUXBmykIQLVqTlWG1vPxgfmEuJOMGObLgpQrYvfQcHq6APOgxx8ojm80i9h1NNkN5iV-xTf8jV6noLRlG8Jyhg5afZqI1lGO4VZA7xa6Ilnn2cX1LKkF68XVNMc-3kOuiLeC6Iwk6qjdNhelaoSgeE7FpP6FcZen8ZJEHb6V4DUsyGn86gTy4tvFyA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00011-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:52<00:00, 95.6MB/s]
2024-03-29 19:01:48,989 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:01:48,989 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
Downloading shards: 58%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 11/19 [09:44<07:02, 52.76s/it]2024-03-29 19:01:49,122 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00012-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:01:49,132 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:01:49,133 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:01:49,182 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00012-of-00019.safetensors%3B+filename%3D%22model-00012-of-00019.safetensors%22%3B&Expires=1712016109&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjEwOX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNDhiYzEyODQ1Njc2ZWFiMWFkYjNjZmNlNzAzN2E3ZWNkNjY0YTBkNWY1ZGVhZjkzYzczNjJhNWJiNTE3MzI5OD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=AGLeuapEY86P-Gyfd9QQlEbKSBlfgjPSyhnMh6cuDZFKqGu2Dpq2N9zKZpC4Q2RdM3oZ5jmCjFYjxCNTCSUH7SsL-cWCo4ZQrpjAoZN1DpCzthlpyGjgqcBuZGfQhcSwUrv2Ci6BUr62uE46BFmDxNGYtzLst210StfNIyNXp5enr63En5fETNjBjE1q9ES2Ik0XGplPncRN5UInZexUV-gQqauSIQcGQxiOf4FQ8zJAQGGsnaMAHMJJ4JqVOerBZmq1NXpnWoSPkFXKwWeCYfs2iKSj1gJtaoIY3yPNTtawDgMOgLQjb4IaO9Ci6y-1s6mec-bDWmghtdRTw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00012-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:55<00:00, 90.2MB/s]
2024-03-29 19:02:44,427 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:02:44,427 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
Downloading shards: 63%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 12/19 [10:40<06:15, 53.58s/it]2024-03-29 19:02:44,507 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00013-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:02:44,549 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:02:44,550 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:02:44,647 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00013-of-00019.safetensors%3B+filename%3D%22model-00013-of-00019.safetensors%22%3B&Expires=1712016164&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjE2NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTU2YTJlN2VkYTY5OWJmNGVjMTQzM2JkMDdkN2NiODY0ODg0MjA4MTNlNjY0NjNkMmUyMjk2ZDdhY2NlYmM1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=RD8KjzaojJfJdyz-qUByQwISMtxKQao-b34iW8-9rqE0iMzghE2qm7mr-HhqbeYOZdp0yXJUyAeujshFRGrW7L0ndZjBoM7n5sXxnlktNFsxEy2KwEE31oDnqIDZqso0d5LMBo7Marl999HkDYvpFyNp0TA3H1WbCeNXdIcBpoaabjKi93T9J05nQUINmVRMVfCkfcmnZ-erdM9Q7V3V4dKSptEUIqm6IM8zWIydAxPFe4ibsrV4YXq6e9oDVW3BAn7Dcu7GJIEKL3vfPdljICifRfBPbCHyY9FVJ-KO-rMLxhR9H4csPH4WfoqCJWjHtMwyS0uRmyK15j6AQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00013-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:53<00:00, 92.6MB/s]
2024-03-29 19:03:38,472 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:03:38,472 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
Downloading shards: 68%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 13/19 [11:34<05:22, 53.72s/it]2024-03-29 19:03:38,592 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00014-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:03:38,601 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:03:38,601 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:03:38,655 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00014-of-00019.safetensors%3B+filename%3D%22model-00014-of-00019.safetensors%22%3B&Expires=1712016218&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjIxOH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZGE2MjdmNmEzYzhmZGM2ZTM1Yjk5MThkMmFhNTM3MDRkNDA0NDE5MWZjYzg2YzdjMGIxYWM1N2YwMGU3MDdmNz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Et7Qgh6fwqvHjpWoq58bmA26296xMVU-GSZlPF4bhGzyd5XFH2EdNaMK4pPcnGkg-kA5zCCkxbToJXkWNTjE0sq1wHqtz7fOCOHbO4ZVFgEd5gWdodd5dcmcAvKMb6RzwsFFipSEWJFZ8un1cK6Q72-1gQ8QnPSqJxaQ0TrT6asaRLc6dH6s74TcvfsAZnmVq9n8OQqnqrFlSoPJjrkCzE2s10oInSCQVGDiGISxSIiFaGnS4j9VtWtHUa70kwiDQiYeaJjvvwf6TCDLyCSolPK0ZYeJGLMBtcWpIFo7JaYhK702HdFAXYYroyM3LmaGjm6ZFc6qJnMORbA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00014-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.90G/4.90G [00:51<00:00, 95.7MB/s]
2024-03-29 19:04:29,876 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:04:29,876 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
Downloading shards: 74%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 14/19 [12:25<04:25, 53.02s/it]2024-03-29 19:04:29,960 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00015-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:04:30,002 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:04:30,002 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:04:30,060 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00015-of-00019.safetensors%3B+filename%3D%22model-00015-of-00019.safetensors%22%3B&Expires=1712016270&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjI3MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjFlMGYyMmJmZjkzYTY4ZTExNGRiYzNkNzVjMWRkMWU2Njg3ZDU1NGRiYTBjZmRmMTc0Mzk1MGFhMDRmZjFjZj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=dqk2EkzCLl1BFXFZ34XuKJsTNqvoMUZPbKtggNgUKFanJzjgotVrBnRl8Z0zSbv71YP-PtGAZGUEzoWwBtqOZvXg1FZPJFxnMAtgD2KiPwoZduRRHk7taI3nETayWiTjzw2qLfCYAUGyhVXW2tHYx4WhMomCpNx2TXcatx1Om1ugAdSiX28-2pME-aGI2PlRqCLEq8iF64MI3KFNdQbxMh221jylIdpRCYkIC5LtAWv0BLGoNWT6tZ5ME6fU96lwuKRaK1g0Yz5qvNAXDK4OBI35xByEYJvy7XLCMSk6DeYUSuEA-qgl7BCRXZXMLJACa-fwVIq4akQo5BZw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00015-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:53<00:00, 93.7MB/s]
2024-03-29 19:05:23,228 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:05:23,228 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
Downloading shards: 79%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 15/19 [13:19<03:32, 53.12s/it]2024-03-29 19:05:23,329 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00016-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:05:23,338 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:05:23,339 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:05:23,437 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00016-of-00019.safetensors%3B+filename%3D%22model-00016-of-00019.safetensors%22%3B&Expires=1712015384&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzY0NjZiZmMyMzEyZjExNTU5NDgwOTgxZjIxMmU0Y2NhNmU5ODA5NmJmOGRmMGZkOTBjY2UxZjBmNDcwOWE5Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Vkz68TR-4Mh8XvS9gijXnE1zOfaR4M4f5ETHhgrB95bjXCrGrzQtbtzmd1uZ2Z4BiJWjXalGcazRqWGBJObSY3EwGpvdhUqWVIsfZ6inwHn7bRk7nvjhvcXXtf8aPErAd3UYIr6maB982usg6CG2WgDzL9EaLWCUpQaPv-SNabLuBaEKtwNuhN74F8G08du9s2zG30cNb3kkgRuFSWWPHoBe3cQvoeVUFxOB97djdIaqwCRrkNrblzwfUhaiMT5Eu1pjYY7iQGWqsnvCLtZfaZbI3QlDKhudsIMeVd3NnPC9wtzQxToelmY4B47BSiEErkglGm0OOQqefqeqrQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00016-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:56<00:00, 88.6MB/s]
2024-03-29 19:06:19,707 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:06:19,707 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
Downloading shards: 84%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 16/19 [14:15<02:42, 54.13s/it]2024-03-29 19:06:19,780 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00017-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:06:19,824 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:06:19,825 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:06:19,877 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00017-of-00019.safetensors%3B+filename%3D%22model-00017-of-00019.safetensors%22%3B&Expires=1712016379&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjM3OX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTcwYWYzYjgwMmJlZGMwZDU0ZDA0ODFkMTI0ZjYzZDQ0OWRkYTQwYTQyOTRhODJhMzlmOGRjMzcwNDA1N2E1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=jqgkdjkjlKDEQH8xHyw53TbZgJz6avUdZkLQVCWFkE9TDtNncnxFj9m0D8PRhB-Jd3fDfvgGTVBz55nvPThWwVV2KcFJgHseggVcleFGc7OQAAwKiad9F9jyrKmgd4ErXkqaGp8GEPqk6mOaU79pp5egpuVaO6wZIKsdIqs8WH-AY9aydNC2rs3UON3NivSaNAD1XQBeEYgvtGYW2T2f8-yByzB-n4p55QTVLN4IPIp5xfdN4DXS0xFlJwXzAjmM2k-mGkhY4iVEmt8sh90hcMPzsGkSX69WZ1qwhsWjWAlMIUjjUS-e-4bCsNeheynlvm8RRDnIpjC1w6wOQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00017-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.90G/4.90G [00:56<00:00, 87.3MB/s]
2024-03-29 19:07:15,993 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:07:15,994 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
Downloading shards: 89%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 17/19 [15:11<01:49, 54.78s/it]2024-03-29 19:07:16,097 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00018-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:07:16,107 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:07:16,108 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:07:16,168 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00018-of-00019.safetensors%3B+filename%3D%22model-00018-of-00019.safetensors%22%3B&Expires=1712014985&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDk4NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNGM2MDNiNjVjYmQ1ZGRhZGNkNWVjZThhZGQ2OGI5ZDQ3Zjk4ZjcyNjRkYmIwYTUzMTMxNzJjNzg0OTFlMDMyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=ZcuF0TPS8vO9fqsPjRdeVKtyWYBG0i1Tg7W56bqLaSPBMrap2SvlHf6VbSllZi-0hVJkOtV7np6nWf9beWVmCZwSrt-94fcjooMiRFc-gColIpWUo-R5kiZfyn8uOlezSfmYuotqC1-uG3sIWLy2Rfc02c-9FNoMgdkYK8ZRDSYRA50FUEVxbQ8LAv2aVJ7tkQhNex3Rsu5U7PqZ1OFvvm83C66rnpOWsEXsKSgjz6N-ac4fBMjvEdVy4iJo4C9fNgJOScK0STjSP9T4ysRMCtT8OXn3IqHsURONVusnjY1zxAq-8MgXpye8rldkYY3KaQmNcHUfGdMMUtw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00018-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.98G/4.98G [00:52<00:00, 95.4MB/s]
2024-03-29 19:08:08,393 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:08:08,393 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
Downloading shards: 95%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ | 18/19 [16:04<00:54, 54.06s/it]2024-03-29 19:08:08,671 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00019-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:08:08,714 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:08,715 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:08,788 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00019-of-00019.safetensors%3B+filename%3D%22model-00019-of-00019.safetensors%22%3B&Expires=1712016488&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjQ4OH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjcyZjMzYzc2YmNhY2Y2Y2ZjZWQ0OTdkYzA1NzllMTA3ZGUzODc0YjlmOTMxMjZmNWU2OWI1YjFhZTdlNzJhMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=MPwahSoVY8iLQNailKD1C53T6XbyddehZFgzKUQYlOfvQSUJFtVenc8B0p8viQqxv8pTnYu140uFG-Egip-S1uUqMYz2z0iKZi6y7wGSjbT1FOht1dW6iMelzSvpi0IHbvL3moT7UGhUIm05cBKWG6a35ly6Nm2wmprE8uFvTEHVXPAj9OPNqyAD2tpHnpkGRtCEInkcEWr8he09cvtGs7JsAZRKY4wUBDhIlCqZBsxzKlMhWseStRMWoCkzaRocElZXFlEuwwW1J8eixoOt6rFPMGzHC7pW7p~mVoKu6mtDnAG9vN7pgP5msrKLuIKNLx14XAiF5LnAlg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4221679088
model-00019-of-00019.safetensors: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4.22G/4.22G [00:48<00:00, 86.5MB/s]
2024-03-29 19:08:57,625 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:57,625 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
Downloading shards: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 19/19 [16:53<00:00, 53.34s/it]
2024-03-29 19:08:58,055 - WARNING - Device 0 is not available, available devices are []
2024-03-29 19:08:58,055 - WARNING - Device 1 is not available, available devices are []
2024-03-29 19:08:58,055 - WARNING - Device 2 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 0 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 1 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 2 is not available, available devices are []
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/Users/toddcurry/AIOS/main.py", line 87, in
main()
File "/Users/toddcurry/AIOS/main.py", line 44, in main
llm = llms.LLMKernel(llm_name, max_gpu_memory, max_new_tokens)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/toddcurry/AIOS/src/llms/llms.py", line 31, in init
self.load_llm_and_tokenizer()
File "/Users/toddcurry/AIOS/src/llms/llms.py", line 56, in load_llm_and_tokenizer
self.model = model_class[self.model_type].from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 561, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3502, in from_pretrained
) = cls._load_pretrained_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3926, in _load_pretrained_model
new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 805, in _load_state_dict_into_meta_model
set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs)
File "/opt/anaconda3/lib/python3.11/site-packages/accelerate/utils/modeling.py", line 387, in set_module_tensor_to_device
new_value = value.to(device)
^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/torch/cuda/init.py", line 293, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled