tree-of-thoughts

tree-of-thoughts copied to clipboard

Add integration to guidance library

19

Thanks a lot for implementing this ToT library, nice work! I think it could benefit a lot from using Microsoft Guidance (https://github.com/microsoft/guidance), specially with smaller local models that have a...

paolorechia

Adding guidance prompt

1

 Actually Guidance leads to GPT 4 spitting out wrong output format, this is strange, I should modify the prompt a little bit. Don't have to merge yet

yhyu13

We need an langchain language model class.

kyegomez

Huggingface plug in and play

3

implement huggingface class

kyegomez

Adds example with text generation web ui for local models

4

Tested with WizardLM 7B, did not work super well, but could be iterated on. I think combining this with the guidance library could be really nice BTW Not sure if...

paolorechia

Evaluations from Paper

2

Action Item: Create a list of example evaluations and measure performance with the following from the paper https://arxiv.org/pdf/2305.10601.pdf some potential eval metrics: Accuracy - Measure how often the model correctly...

kyegomez

UnboundLocalError: local variable 'prompt'

2

Getting this error from the example.py \tree-of-thoughts\tree_of_thoughts\treeofthoughts.py", line 144, in evaluate_states prompt = f"Given the current state of reasoning: '{state_text}', evaluate its value as a float between 0 and 1,...

AshVR

Aditya007Datta

Thank you for implementing the ToT paper. I have a question though, is there anyway where this can be used with GP-4 running on the web ChatGPT with plugins? If...

AZm1n

kyegomez