Raoof Naushad

@Ourspolaire1 The way I did is almost what similar to @kaiyux mentioned above. - Follow the README.md to [Download llama3 8B checkpoint](https://github.com/meta-llama/llama3) - [Convert checkpoint & Build TensorRT LLM Engine](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/llama#llama-v3-updates)...

@dosu I changed my code like this: ``` from llama_index.llms.openai import OpenAI Settings.llm = OpenAI( model=C.LLM_MODEL, temperature=0, max_tokens=4000, api_base=os.environ.get('GW_BASE_URL'), api_key=get_api_key() ) from llama_index.core.tools import FunctionTool get_client_comparison_tool = FunctionTool.from_defaults(fn=get_client_comparison) get_compared_to_peer_group_tool =...

@dosu I am still getting this error at times. Again the problem here is: I am trying to use the StructuredPlannerAgent with FunctionCallingAgentWorker. I am getting an error at times...

@dosu That gives me new error: ``` File ~/Documents/amplify/hermes/utilities/research_rag/venv/lib/python3.9/site-packages/llama_index/core/agent/runner/planner.py:258, in StructuredPlannerAgent.create_plan(self, input, **kwargs) 256 if self.verbose: 257 print(f"=== Initial plan ===") --> 258 for sub_task in plan.sub_tasks: 259 print( 260...