web-llm
web-llm copied to clipboard
Error running the function calling example: Cannot find global function mlc.serve.BNFGrammarGetGrammarOfJSON
What's the issue?
The following error is thrown when running the function calling example:
index.js:2883 Uncaught (in promise) Error: Cannot find global function mlc.serve.BNFGrammarGetGrammarOfJSON
at Instance.getGlobalFuncInternal (index.js:2883:23)
at Instance.getGlobalFunc (index.js:2870:25)
at new GrammarFactory (grammar.ts:31:11)
at new LLMChatPipeline (llm_chat.ts:99:27)
at Engine.<anonymous> (engine.ts:210:21)
at Generator.next (<anonymous>)
at fulfilled (tslib.es6.js:118:58)
How to reproduce?
- Clone the latest code;
-
cd examples/function-calling
; -
npm i && npm start
; - Visit
localhost:8888
on browser and wait until the model done loading; - Check console to see the error.
Function calling is a WIP and will be updated soon! Apologies for the inconvenience. All other examples should be working and feel free to try them out
Cool, thanks for the reply, Charlie 👍 Is there a rough estimate of when the update will be released? Thanks.
This weekend / early next week!