text-to-sql
                                
                                
                                
                                    text-to-sql copied to clipboard
                            
                            
                            
                        New dataset
Will this work only on spider dataset, I mean what if new data comes in?
Thank you for the question, I'm sorry I'm just now seeing this!
I've been prioritizing some other projects, so I haven't done as much building out as I would have hoped. But this process should work with any sqlite database. It really just works to pull the schema information. As long as that schemea doesn't change it would be able to write the query and run against the database.
I just used the spider dataset as a test because it was publicly available data with a lot of diverse structures.
I will say - the big limit will be if you have another type of database. That's something I'd love to be able to explore with time, but in the meantime I'd checkout langchain. I struggled to adapt some of the out-of-the-box agents, but they have a really adaptable flow for dealing with different types of databases!