trustfall icon indicating copy to clipboard operation
trustfall copied to clipboard

has anyone tried teaching GPT-3 to write queries?

Open ericries opened this issue 2 years ago • 4 comments

Just discovered this project via HN, super cool btw. I've always wanted something like this to exist.

I wonder if you already have enough examples of natural language -> query to fine tune a transformer model to generate them with high accuracy. Would be curious to play with this if anyone is interested.

ericries avatar Feb 09 '23 04:02 ericries

Hi! Thanks for checking out the project :)

I've definitely thought about something like this, it feels like it should be possible. The query language isn't semantically equivalent to GraphQL, but the syntax is a subset of GraphQL so it hopefully shouldn't require too much additional work to make it happen.

You should be able to get a dozen or so examples from the web playground's prewritten queries, and another 40 queries + English language descriptions from cargo-semver-checks lints.

I'd love to see what you can come up with on this! Please share your results here and let me know if I can help in any way!

obi1kenobi avatar Feb 09 '23 05:02 obi1kenobi

do you mind if I ask you a few questions over email?

On Wed, Feb 8, 2023 at 9:32 PM Predrag Gruevski @.***> wrote:

Hi! Thanks for checking out the project :)

I've definitely thought about something like this, it feels like it should be possible. The query language isn't semantically equivalent to GraphQL, but the syntax is a subset of GraphQL that it hopefully shouldn't require too much additional work to make it happen.

You should be able to get a dozen or so examples from the web playground's prewritten queries https://github.com/obi1kenobi/trustfall/tree/main/experiments/browser_based_querying/example_queries, and another 40 queries + English language descriptions from cargo-semver-checks lints https://github.com/obi1kenobi/cargo-semver-checks/tree/main/src/lints.

I'd love to see what you can come up with on this! Please share your results here and let me know if I can help in any way!

— Reply to this email directly, view it on GitHub https://github.com/obi1kenobi/trustfall/issues/133#issuecomment-1423657689, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACKSLRSWEFMY62R5PPD4NYLWWR6N7ANCNFSM6AAAAAAUWB22C4 . You are receiving this because you authored the thread.Message ID: @.***>

ericries avatar Feb 09 '23 06:02 ericries

Go for it. Use the one on my commits and let's go from there? I don't want to post it here, too many GitHub scrapers...

Heads-up that I'm on US Eastern time and it's well past my bedtime, so I'll almost certainly only reply in the morning.

obi1kenobi avatar Feb 09 '23 06:02 obi1kenobi

did my email come through?

On Wed, Feb 8, 2023 at 10:29 PM Predrag Gruevski @.***> wrote:

Go for it. Use the one on my commits and let's go from there? I don't want to post it here, too many GitHub scrapers...

Heads-up that I'm on US Eastern time and it's well past my bedtime, so I'll almost certainly only reply in the morning.

— Reply to this email directly, view it on GitHub https://github.com/obi1kenobi/trustfall/issues/133#issuecomment-1423702661, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACKSLRR4GUAD4R7SYOZZNETWWSFEFANCNFSM6AAAAAAUWB22C4 . You are receiving this because you authored the thread.Message ID: @.***>

ericries avatar Feb 10 '23 01:02 ericries