text-to-sql icon indicating copy to clipboard operation
text-to-sql copied to clipboard

Adapting to Input Token Limits

Open BrettlyCD opened this issue 2 years ago • 0 comments

Using the Inference API with Hugging face has a limit of input tokens. Many of the schemas have more table information than can be put into a prompt. So you can either pay OR come up with a way to be more efficient with the space and target only relevant tables.

BrettlyCD avatar Jul 29 '23 00:07 BrettlyCD