llms-with-matlab icon indicating copy to clipboard operation
llms-with-matlab copied to clipboard

Adding Embedding functionality

Open Lenskiy opened this issue 6 months ago • 0 comments

Currently Matlab access to Ollama only supports text generation, but not the embeddings. However, adding this functionality should not be hard, here is a snippet:

url = 'http://localhost:11434/api/embeddings';
data = struct(...
        'model', 'llama3.1', ...
        'prompt', 'Llamas are members of the camelid family');
    
% Send the HTTP POST request
options = weboptions('MediaType', 'application/json');
response = webwrite(url, data, options)
disp(response.embedding)

Lenskiy avatar Aug 06 '24 10:08 Lenskiy