songkq

1. Support public LLMs and OpenAI API as a LLM service in QAnything. 2. Provide a detailed usage of QAnything Startup Command and LLM interface.

Docker run failed with runtime/cgo: pthread_create failed: Operation not permitted

1

@songquanpeng Hi, could you please give some advice for this issue? **例行检查** [//]: # (方框内删除已有的空格，填 x 号) + [x] 我已确认目前没有类似 issue + [x] 我已确认我已升级到最新版本 + [x] 我已完整查看过项目 README，尤其是常见问题部分 + [x]...

Deepspeed Zero3 support

3

@danielhanchen Hi, could you please give some advice for this issue? DPO training failed with Deepspeed Zero3 offload. ``` pip install "unsloth[cu121-ampere-torch211] @ git+https://github.com/unslothai/unsloth.git" torch 2.1.1+cu121 unsloth 2024.1 Driver Version:...

Support Qwen2

16

Hi, do you have plan to support Qwen2 training acceleration? ``` From transformers >= 4.37.0: https://github.com/huggingface/transformers/blob/abbffc4525566a48a9733639797c812301218b83/src/transformers/models/qwen2/modeling_qwen2.py ```

Vocab size of 102400 exceeds the max CUDA blocksize of 65536 using A40 GPU

3

@danielhanchen @shimmyshimmer Hi, do you have plan to develop some efficient kernels for this issue? Unsloth: Vocab size of 102400 exceeds the max CUDA blocksize of 65536. For now, Unsloth...

@DataXujing Hi，请问是否尝试过使用TensorRT-API方式从量化训练导出的Q/DQ-onnx模型构建trt_int8 engine？ 我尝试直接使用trtexec对Q/DQ-onnx进行转换，nsight分析发现推理过程transpose+reshape耗时占用高，想结合api的方式优化这部分性能，可否给一些建议？多谢～

Alternatives to You.com search API

14

@shaoyijia @Yucheng-Jiang Hi, I'm wondering if there are some other search APIs can be used for storm since that You.com API requires a credit card. https://github.com/stanford-oval/storm/blob/42f4d5bbbaca67bc2e4e8ea5814e0975fef971fc/src/modules/topic_expert.py#L79 For example, can these...

DOMException 500 Error

1

@hanxiao Could you please give some advice for this issue? ``` `https://r.jina.ai/https://www.msn.com/en-us/news/technology/the-best-ai-search-engines-and-tools-you-can-use-to-search-the-web/ar-BB1kbzFL` {"code":500,"status":50000,"message":"Failed to execute 'setAttribute' on 'Element': '}' is not a valid attribute name.","name":"DOMException"} ```

Support DuckDuckGoSearchAPI and TavilySearchAPI as Alternatives to You.com

2

1. Support `DuckDuckGoSearchAPI` and `TavilySearchAPI` as Alternatives to `You.com`. 2. When enabling TopicExpert to use `DuckDuckGoSearchAPI` or `TavilySearchAPI`, these APIs will return compelete contents instead of snippets as default. 3....