Adding custom data to chat with prevents the chatbot from answering questions not in the data
Hi, I have created a chatbot using GPT4 model with custom data in Azure AI studio and its working very well! But the problem is, it answers questions that have answers in the provided custom data only. Is there a way to make it answer all question like normal chat GPT but when the answer is in the data it references the custom data? Thanks
Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.
- ID: c62bfd5b-2d53-5c69-7dbb-345b9195414b
- Version Independent ID: 7ab9ec9e-85e0-0063-b998-9fe3d7b0d8ac
- Content: Deploy a web app for chat on your data in the Azure AI Studio playground - Azure AI Studio
- Content Source: articles/ai-studio/tutorials/deploy-chat-web-app.md
- Service: azure-ai-studio
- GitHub Login: @aahill
- Microsoft Alias: aahi
@mohamedFaris47 Thanks for your feedback! We will investigate and update as appropriate.
Hello @mohamedFaris47 To expand the capabilities of the default GPT-4 model in Azure AI Studio beyond its original dataset, consider two approaches:
-
Fine-tuning with a Larger Dataset: Train the model on a more diverse dataset covering a wider range of topics. This can be achieved through transfer learning, where the model is initially trained on a smaller dataset specific to your needs and then fine-tuned on a larger, diverse dataset.
-
Combination with Rule-based Systems: Use a hybrid approach by combining the GPT-4 model with a rule-based system. The GPT-4 model generates responses for general questions, while the rule-based system handles specific questions using custom data, providing more targeted answers.
These strategies help enhance the model's ability to generate responses across various topics and handle specific queries effectively. I hope this helps! If there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.
Thanks a lot for the help!
@mohamedFaris47 We are going to close this thread as resolved but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.
#Please-close