Orion
Orion copied to clipboard
OrionStarAI
Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. Ori...
llm_load_tensors: ggml ctx size = 0.41 MiB ggml_backend_metal_buffer_from_ptr: error: failed to allocate buffer, size = 0.00 MiB llama_model_load: error loading model: failed to allocate buffer llama_load_model_from_file: failed to load model...
在[generation_utils.py](https://huggingface.co/OrionStarAI/Orion-14B-Chat/blob/main/generation_utils.py)的`build_chat_input`函数里没有看到system prompt相关的内容，想问一下模型是否支持使用sytem prompt推理/训练？
  环境变量如上，但是没有输出结果，对于tool的URL：用的是代码里面自带的，请问下该怎么办
Hi, when i run Orion-14B-Chat-Int4, by following code on A800-80G ``` import torch from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig model_name = "OrionStarAI/Orion-14B-Chat-Int4" tokenizer = AutoTokenizer.from_pretrained(model_name, use_fast=False, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained(model_name,...
Metadata
Owner
Metadata
Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. Ori...