Jasper James

Is there an interface for developers to call?

1

Is there an interface for developers to call?

llama3_instruct_70b_q8 does not work properly in Ollama.

1

I added the model in gguf format from llama3_instruct_70b_q8 to ollama and used ollama for inference, and got the error shown below: ``` time=2024-04-24T15:08:27.886+08:00 level=WARN source=server.go:51 msg="requested context length is...

Is there an interface that can be called in Python code? Not using CLI

All features, can add the option to accept the contents of the file without having to pass in one file at a time.

1

Is it possible to add an option inside the program to accept code contents directly as input instead of having to accept a file?

Is there support for local LLM?

13

Is there any plan to support local offline models?

[BUG] `Too many function arguments, the program crashes`

9

When there are too many function arguments, the program crashes with no output error after encryption with pyarmor. I have a PyQt6 program, I put the menu production in a...

Multi GPU are not supported？

4

I have multi GPUs, but only run on one ``` (deblur_venv) xlab@xlab:/mnt/DiffBIR$ python -u inference.py --version v2 --task sr --upscale 4 --cfg_scale 4.0 --input /mnt/image_demos/ --output /mnt/image_demos/ouput --device cuda use...

It is not possible to format the code shown below

4

[pcie5_cfgchk.zip](https://github.com/user-attachments/files/16656314/pcie5_cfgchk.zip)

Unknown error

3

I used python code like the one below, with an error at pyslang==7.0, which worked perfectly at pyslang==6.0, but couldn't get any error messages. If the main process calls the...