werruww

text = "Write a Python code to print the letter X 100 times." # Tokenize the input text input_ids = tokenizer(text, return_tensors="pt").input_ids.to("cuda:0") # Generate text res = model.generate(input_ids, max_length=128) #...

Does the library support 4bit?

https://github.com/werruww/EETQ-quantization/blob/main/suc_EETQ.ipynb

conda install conda-forge::llama-cpp-python not work

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. gensim 4.3.0 requires FuzzyTM>=0.4.0,...

pip install -U llama-cpp-python .uvuv pip install -U llama-cpp-pythonpipuv What do you mean and what is the correct installation command that stops in pyproject.toml?

(u) C:\Users\m\Desktop\1>python 1.py Traceback (most recent call last): File "C:\Users\m\AppData\Local\anaconda3\envs\u\Lib\site-packages\llama_cpp\llama_cpp.py", line 75, in _load_shared_library return ctypes.CDLL(str(_lib_path), **cdll_args) # type: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\m\AppData\Local\anaconda3\envs\u\Lib\ctypes\__init__.py", line 376, in __init__ self._handle = _dlopen(self._name,...

README udocker is not mentioned I want to run Docker imsage in Colab because I want to run OpenHands and like this And I failed to get that to work.

are you run https://github.com/All-Hands-AI/OpenHands/blob/main/Development.md on colab

(b) C:\Users\m\Desktop\1>netstat -aon | findstr :11434 TCP 127.0.0.1:11434 0.0.0.0:0 LISTENING 4184 TCP 127.0.0.1:11434 127.0.0.1:58211 ESTABLISHED 4184 TCP 127.0.0.1:58211 127.0.0.1:11434 ESTABLISHED 2628