unstract icon indicating copy to clipboard operation
unstract copied to clipboard

feat: [ISSUE]

Open abc-w opened this issue 1 year ago • 1 comments

May I ask for your advice,how can i modify code to use my personal fintune LLM and ocr tool?

abc-w avatar Sep 20 '24 04:09 abc-w

If you are running the LLM via ollama you can connect to the system. For the personal OCR if it is not in the list of supported adapters currently you can't use with the platform. We don't have documentation on how to add a new connector as of now cc: @arun-venkataswamy @hari-kuriakose @gaya3-zipstack

ritwik-g avatar Sep 20 '24 05:09 ritwik-g

@abc-w Please find the updated steps to add a new adapter here: https://docs.unstract.com/unstract/contributing/unstract/sdk/contribute-adapter/

That being said, as mentioned we already support Ollama if that's how you are deploying your LLM, or you might have to write a custom LLM adapter as outlined in the doc above.

For your custom OCR tool, you might have to write a custom X2Text adapter as per the same doc.

hari-kuriakose avatar Dec 09 '24 08:12 hari-kuriakose