bee-agent-framework icon indicating copy to clipboard operation
bee-agent-framework copied to clipboard

Update default examples to llama3.2

Open mmurad2 opened this issue 1 year ago • 4 comments

Background Our current default examples are implemented with llama3.1 as the LLM used. Now that llama3.2 dropped we want to update the core examples in the repo.

What to update

  • [ ] https://github.com/i-am-bee/bee-agent-framework?tab=readme-ov-file#example
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/llms/providers/ollama.ts
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/agents/bee_advanced.ts
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/agents/bee.ts
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/agents/sql.ts
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/llms/providers/watsonx.ts
  • [ ] https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/llms/providers/watsonx_verbose.ts

Acceptance criteria

  • [ ] Validate that the model swap doesn't impact the performance of the example. Compare example performance before and after switch.

mmurad2 avatar Oct 01 '24 23:10 mmurad2

@mmurad2 Interested in working on this issue could you assign this to me so that i can work on it ? I Need to implement the example model of llama 3.2 where currently we have llama 3.1 right? We need to update the models that are supported in the adapters to use it in these two files

examples/agents/bee_advanced.ts examples/llms/providers/watsonx.ts

Abiji-2020 avatar Oct 02 '24 03:10 Abiji-2020

Yes correct, feel free to reach out if you have any questions! cc: @Tomas2D

mmurad2 avatar Oct 02 '24 13:10 mmurad2

Great @Abiji-2020!

Firstly you need to define the model template in src/adapters/shared/llmChatTemplates.ts. then you have to updates presets for BAM and WatsonX, finally update the examples.

Tomas2D avatar Oct 02 '24 15:10 Tomas2D

@Tomas2D I have updated the templates and then updated the presets for the both. The PR #51 was updated on that

Abiji-2020 avatar Oct 02 '24 15:10 Abiji-2020