Kaggle FSSPEC_VERSION on new VMs

[danielhanchen]

FSSPEC_VERSION = version.parse(importlib.metadata.version("fsspec"))

File /opt/conda/lib/python3.10/site-packages/packaging/version.py:264, in Version.__init__(self, version)
    261 def __init__(self, version: str) -> None:
    262 
    263     # Validate the version and parse it into pieces
--> 264     match = self._regex.search(version)
    265     if not match:
    266         raise InvalidVersion(f"Invalid version: '{version}'")

TypeError: expected string or bytes-like object

[patrickjchen]

Hi Dan, anyway to get around this error before it is fixed?

[danielhanchen]

@patrickjchen If you clone the Mistral notebook from https://www.kaggle.com/code/danielhanchen/kaggle-mistral-7b-unsloth-notebook as is, it should work. New Kaggle envs are broken for now

[danielhanchen]

@patrickjchen I re-did the Kaggle notebook and fixed the issue! Use the latest one here: https://www.kaggle.com/code/danielhanchen/kaggle-mistral-7b-unsloth-notebook

[patrickjchen]

Thanks! It works!

[patrickjchen]

Running again, got this error: ValueError: pyarrow.lib.IpcWriteOptions size changed, may indicate binary incompatibility. Expected 88 from C header, got 72 from PyObject When running: model, tokenizer = FastLanguageModel.from_pretrained( model_name = "unsloth/mistral-7b-bnb-4bit", # Choose ANY! eg teknium/OpenHermes-2.5-Mistral-7B max_seq_length = max_seq_length, dtype = dtype, load_in_4bit = load_in_4bit, # token = "hf_...", # use one if using gated models like meta-llama/Llama-2-7b-hf )

[danielhanchen]

@patrickjchen I re-ran my notebook - it seems to work fine. If you're using your own notebook, you need to exactly copy the notebook I provided, then add your code in. Unfortunately Kaggle can be very finnicky

[patrickjchen]

Thanks, Dan. Yeah, I need to first download the packages , then install them without internet connection. Is that torch 2.2.2 is used by the notebook? It's implicitly installed when xformers were installed?

[danielhanchen]

@patrickjchen Hmm I think it's torch 2.2.1 or 2.2.2 tbh unsure. Yes xformers itself installs torch