bidara-deep-chat icon indicating copy to clipboard operation
bidara-deep-chat copied to clipboard

Support code_interpreter and vision for file uploads

Open bruffridge opened this issue 6 months ago • 2 comments

Deep-chat 2.0 added support for v2 Assistants API. It also changed how uploaded files are handled. Now there is a files_tool_type parameter that determines which tool operates on file uploads. So instead of letting OpenAI decide all uploaded files are handled by the tool set by the parameter. This means ALL uploaded files can only be handled by one tool. We want it to be based on the file and what the user asks. For example, uploaded images should be passed to the gpt-4o for vision. Other files such as excel and csv the user might want visualized via code_interpreter. PDFs may want summarized via file_search.

https://github.com/OvidijusParsiunas/deep-chat/issues/190#issuecomment-2138206061

bruffridge avatar Aug 13 '24 17:08 bruffridge