-
Notifications
You must be signed in to change notification settings - Fork 204
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ConnectionError #227
Comments
This looks like a networking error on your side. Perhaps your network is blocking Huggingface? |
Encountered this trying to use AutoAWQ in an environment not connected to the internet. I think huggingface/datasets#3547 means that even with a populated cache with the required dataset you need an internet connection. Workaround is to pass in the path to the relevant cache folder, for example: model.quantize(
tokenizer,
quant_config=quant_config,
calib_data="<some path>/hub/datasets--mit-han-lab--pile-val-backup/snapshots/2f5e46ae6a69cf0dce4b12f78241c408936ca0e4",
split = "validation"
) |
Since the latest version of |
Oh - nice, I guess it must be some issue with my cache then, using |
Traceback (most recent call last):
File "/home/fubo/code/course/autoawq.py", line 13, in
model.quantize(tokenizer, quant_config=quant_config)
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/awq/models/base.py", line 49, in quantize
quantizer = AwqQuantizer(
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/awq/quantize/quantizer.py", line 27, in init
self.modules, self.module_kwargs, self.inps = self.init_quant()
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/awq/quantize/quantizer.py", line 302, in init_quant
samples = get_calib_dataset(
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/awq/utils/calib_data.py", line 11, in get_calib_dataset
dataset = load_dataset("mit-han-lab/pile-val-backup", split="validation")
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/datasets/load.py", line 2128, in load_dataset
builder_instance = load_dataset_builder(
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/datasets/load.py", line 1814, in load_dataset_builder
dataset_module = dataset_module_factory(
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/datasets/load.py", line 1511, in dataset_module_factory
raise e1 from None
File "/home/fubo/.conda/envs/autoawq/lib/python3.10/site-packages/datasets/load.py", line 1467, in dataset_module_factory
raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({type(e).name})")
ConnectionError: Couldn't reach 'mit-han-lab/pile-val-backup' on the Hub (SSLError)
The text was updated successfully, but these errors were encountered: