Upload PDFs to chat

[mariuszkumor]

Hi, do you know any component I can use easily in langflow to upload PDFs to OpenAI Chat and ask questions related to?

[dosubot[bot]]

🤖

Hey @mariuszkumor, great to see you back around here! How's it going?

Sure, you can use the uploadFile function to upload PDFs to the server. This function is part of the API controller in the frontend of langflow. Here is the function:

/**
 * Uploads a file to the server.
 * @param {File} file - The file to upload.
 * @param {string} id - The ID of the flow to upload the file to.
 */
export async function uploadFile(
  file: File,
  id: string
): Promise<AxiosResponse<UploadFileTypeAPI>> {
  const formData = new FormData();
  formData.append("file", file);
  return await api.post(`${BASE_URL_API}upload/${id}`, formData);
}

You can find this function in the API controller of the langflow repository.

However, this function only uploads the file to the server. It does not integrate with OpenAI Chat or ask related questions. For that, you would need to implement additional functionality.

As for interacting with OpenAI Chat, langflow does have built-in functionality for this. The ChatOpenAIComponent class in the src/backend/langflow/components/llms/ChatOpenAI.py file is used to interact with the OpenAI Chat API. Here is the relevant code:

def build(
        self,
        max_tokens: Optional[int] = 256,
        model_kwargs: NestedDict = {},
        model_name: str = "gpt-4-1106-preview",
        openai_api_base: Optional[str] = None,
        openai_api_key: Optional[str] = None,
        temperature: float = 0.7,
    ) -> Union[BaseLanguageModel, BaseLLM]:
        if not openai_api_base:
            openai_api_base = "https://api.openai.com/v1"
        return ChatOpenAI(
            max_tokens=max_tokens,
            model_kwargs=model_kwargs,
            model=model_name,
            base_url=openai_api_base,
            api_key=openai_api_key,
            temperature=temperature,
        )

You can find this class in the ChatOpenAI.py file of the langflow repository.

To ask questions related to the uploaded PDF, you would need to extract the text from the PDF, send it to OpenAI Chat, and then process the response. This would require additional code that is not currently part of langflow.

Sources

• src/frontend/src/controllers/API/index.ts
• src/backend/langflow/components/llms/ChatOpenAI.py

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.