Simas Janusas comments

Results 3 comments of


                                            Simas Janusas

Invalid Output Parser Format for "Router Chain"

> I resolved the problem by adding an example at the end of the MULTI_PROMPT_ROUTER_TEMPLATE. Please check it as below. > > ### eg: > > "What is black body...

{tool_name} is not a valid tool, try another one.

Came across after getting errors implementing [tokens used code](https://python.langchain.com/en/latest/modules/models/llms/examples/token_usage_tracking.html) Worked by selecting agent type of `STRUCTURED_CHAT_ZERO_SHOT_REACT_DESCRIPTION` ``` agent = initialize_agent(tools, llm, agent=AgentType.STRUCTURED_CHAT_ZERO_SHOT_REACT_DESCRIPTION, verbose=True) ```

can't run llama-2-7b-hf even though I'm using use_auth_token

Try using a different provider. example: ``` # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("togethercomputer/LLaMA-2-7B-32K") model = AutoModelForCausalLM.from_pretrained("togethercomputer/LLaMA-2-7B-32K") ```