Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Create new page to query a live model

Open fozziethebeat opened this issue 2 years ago • 3 comments

This new page should query the path made in #425 with a prompt written by the user and then display the results. The user should be able to request a response from one or more models in a drop down. Those model IDs can be hard coded for now.

It should also make it easy to reset the view and start over.

fozziethebeat avatar Jan 06 '23 05:01 fozziethebeat

The inference server now exists. Once there's a docker setup, we should use the interactive text-client example to prototype live model interaction.

This should be blocked by a feature flag since it won't be ready for real usage for a while and we need to frame how and when users should use it.

fozziethebeat avatar Jan 24 '23 07:01 fozziethebeat

This seems to have been resolved by #1915

olliestanley avatar Mar 01 '23 20:03 olliestanley

Actually - we can leave this open for now, there are elements of this ticket which are not complete e.g. the dropdown to select model

olliestanley avatar Mar 01 '23 20:03 olliestanley

I will close this now, even though we don't have the drop down, I don't think we will need it, and we can always create a new issue.

AbdBarho avatar Mar 05 '23 06:03 AbdBarho