LLM.swift icon indicating copy to clipboard operation
LLM.swift copied to clipboard

getting 'noFilteredURL' thrown

Open nimrodbens opened this issue 10 months ago • 0 comments

i'm trying to initialize 'deepset/roberta-base-squad2' model, and i get this error.

let systemPrompt = "I want you to analyze an answer to a question."
let bot = try await LLM(from: HuggingFaceModel("deepset/roberta-base-squad2", template: Template(systemPrompt: systemPrompt)))

and the error is being thrown in the init. to my understanding there is no link in the html file to download the model directly.

are the only two methods to interact with a model is to have it as a file locally or to download it?

i saw that some model weigh a few GB so either way is not feasible for my app.

i'm new with LLM so sorry if i asked obvious questions.

nimrodbens avatar Apr 04 '24 13:04 nimrodbens