LLM.swift
LLM.swift copied to clipboard
getting 'noFilteredURL' thrown
i'm trying to initialize 'deepset/roberta-base-squad2' model, and i get this error.
let systemPrompt = "I want you to analyze an answer to a question."
let bot = try await LLM(from: HuggingFaceModel("deepset/roberta-base-squad2", template: Template(systemPrompt: systemPrompt)))
and the error is being thrown in the init. to my understanding there is no link in the html file to download the model directly.
are the only two methods to interact with a model is to have it as a file locally or to download it?
i saw that some model weigh a few GB so either way is not feasible for my app.
i'm new with LLM so sorry if i asked obvious questions.