Feature: Get topic suggestions for new links

[wilmeragsgh]

This PR adds:

Changes

Grafbase resolver to get topic suggestions on a new link

Using a new link web page description from its meta tags we create an embedding for the link using the baai/bge-large-en-v1.5 model and search in a Qdrant instance to get the most similar GlobalTopic to the new link and suggest it.

Grafbase resolver to get single questions answers from a global topic

Passing the topic name and question as arguments to it, we use meta/llama-2-7b-chat-int8 to set a prompt where the model is an expert on the given topic and answers questions on the said topic. The current setup only considers single questions answers, meaning it would not handle multi-step interactions yet.

Limitations

The current setup only works on the web app as Grafbase ai workers integration does not work locally yet.

[grafbase[bot]]

Project was successfully deployed.

https://grafbase.com/learn-anything/learn-anything/feature%2Furl-topic-suggestions

[nikivdev]

Will be merged at a later time.