azure-docs icon indicating copy to clipboard operation
azure-docs copied to clipboard

Adding custom data to chat with prevents the chatbot from answering questions not in the data

Open mohamedFaris47 opened this issue 1 year ago • 1 comments

Hi, I have created a chatbot using GPT4 model with custom data in Azure AI studio and its working very well! But the problem is, it answers questions that have answers in the provided custom data only. Is there a way to make it answer all question like normal chat GPT but when the answer is in the data it references the custom data? Thanks


Document Details

Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

mohamedFaris47 avatar Apr 28 '24 09:04 mohamedFaris47

@mohamedFaris47 Thanks for your feedback! We will investigate and update as appropriate.

TPavanBalaji avatar Apr 28 '24 15:04 TPavanBalaji

Hello @mohamedFaris47 To expand the capabilities of the default GPT-4 model in Azure AI Studio beyond its original dataset, consider two approaches:

  1. Fine-tuning with a Larger Dataset: Train the model on a more diverse dataset covering a wider range of topics. This can be achieved through transfer learning, where the model is initially trained on a smaller dataset specific to your needs and then fine-tuned on a larger, diverse dataset.

  2. Combination with Rule-based Systems: Use a hybrid approach by combining the GPT-4 model with a rule-based system. The GPT-4 model generates responses for general questions, while the rule-based system handles specific questions using custom data, providing more targeted answers.

These strategies help enhance the model's ability to generate responses across various topics and handle specific queries effectively. I hope this helps! If there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.

Naveenommi-MSFT avatar Apr 30 '24 10:04 Naveenommi-MSFT

Thanks a lot for the help!

mohamedFaris47 avatar Apr 30 '24 10:04 mohamedFaris47

@mohamedFaris47 We are going to close this thread as resolved but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.

#Please-close

Naveenommi-MSFT avatar May 02 '24 05:05 Naveenommi-MSFT