CASALIOY
CASALIOY copied to clipboard
no module named Casalioy
.env
Generic
MODEL_N_CTX=1024 TEXT_EMBEDDINGS_MODEL=sentence-transformers/all-MiniLM-L6-v2 TEXT_EMBEDDINGS_MODEL_TYPE=HF # LlamaCpp or HF USE_MLOCK=true
Ingestion
PERSIST_DIRECTORY=db DOCUMENTS_DIRECTORY=source_documents INGEST_CHUNK_SIZE=500 INGEST_CHUNK_OVERLAP=50
Generation
MODEL_TYPE=LlamaCpp # GPT4All or LlamaCpp MODEL_PATH=eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin MODEL_TEMP=0.8 MODEL_STOP=[STOP] CHAIN_TYPE=stuff N_RETRIEVE_DOCUMENTS=100 # How many documents to retrieve from the db N_FORWARD_DOCUMENTS=6 # How many documents to forward to the LLM, chosen among those retrieved
Python version
3.11.5
System
14.0 (23A344
CASALIOY version
v0.1.1 ->https://github.com/su77ungr/CASALIOY/tree/gguf-fix
Information
- [X] The official example scripts
- [ ] My own modified scripts
Related Components
- [X] Document ingestion
- [ ] GUI
- [ ] Prompt answering
Reproduction
python ingest.py --device_type mps
Traceback (most recent call last):
File "/Users/ac/Documents/mc2/projects/casalioygpt/casapoetry/casalioygpt/casalioy/ingest.py", line 26, in
Expected behavior
it should start ingesting files