semantic-router icon indicating copy to clipboard operation
semantic-router copied to clipboard
verified publisher icon aurelio-labs

Function call does not work

Open lekhnath opened this issue 1 year ago • 5 comments

I followed the this example :

https://github.com/aurelio-labs/semantic-router/blob/main/docs/05-local-execution.ipynb

But it did not call the function from dynamic routing. Instead it got stuck on Extracting function input.... And jupyter notebook kernel restarted without completing the process.

Screenshot Attached

image

lekhnath avatar Nov 26 '24 03:11 lekhnath

hi @lekhnath what hardware are you running this on? It looks like an out of memory error, so we could try using a smaller model or try running on Google Colab with T4 GPU instances

jamescalam avatar Nov 26 '24 22:11 jamescalam

@jamescalam I tried running this example in two environments and got same issue on both:

  1. M3 Macbook pro
  2. 16 GB NVIDIA-T4 GPU on AWS (Instance Type: g4dn.xlarge)

lekhnath avatar Nov 27 '24 04:11 lekhnath

@lekhnath I can reproduce, we're currently working through a refactor / upgrade across many places in the codebase, we'll include a bug fix for this in there. Should be this week

jamescalam avatar Nov 27 '24 23:11 jamescalam

@jamescalam I'm really looking forward to this! Can't wait to integrate this feature into my codebase.

lekhnath avatar Nov 28 '24 03:11 lekhnath

so this bug was fixed in version=0.1.0?

CEfanmin avatar Jan 16 '25 07:01 CEfanmin