cannot pickle '_thread.RLock' object

[sambantham-p]

Traceback (most recent call last): File "D:\news agent\venv\Lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 534, in _run_script exec(code, module.dict) File "D:\news agent\main.py", line 31, in final = qa.qaretriever(question,urls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\news agent\qaretriever.py", line 35, in qaretriever pickle.dump(vector_index, f) TypeError: cannot pickle '_thread.RLock' object

[cabdelahad]

did you solve this ?

[HariPrasanth]

Hi, Were you able to solve this issue?

[HariPrasanth]

The answer is : We will have to use vectorstore methods only to dump into a file and retrieve it instead of using pickle

Just replaced the code

with open(file_path, "wb") as f:
    pickle.dump(vectorstore_openai, f)

With this line vectorstore_openai.save_local("vectorstore")

And

replace this code vectorstore = pickle.load(f) with vectorstore = FAISS.load_local("vectorstore", OpenAIEmbeddings(), allow_dangerous_deserialization=True)