llms-with-matlab icon indicating copy to clipboard operation
llms-with-matlab copied to clipboard

Connect MATLAB to LLM APIs, including OpenAI® Chat Completions, Azure® OpenAI Services, and Ollama™

Large Language Models (LLMs) with MATLAB

Open in MATLAB Online View Large Language Models (LLMs) with MATLAB on File Exchange

This repository contains code to connect MATLAB® to the OpenAI® Chat Completions API (which powers ChatGPT™), OpenAI Images API (which powers DALL·E™), Azure® OpenAI Service, and both local and nonlocal Ollama™ models. This allows you to leverage the natural language processing capabilities of large language models directly within your MATLAB environment.

Requirements

MathWorks Products (https://www.mathworks.com)

  • Requires MATLAB release R2024a or newer.
  • Some examples require Text Analytics Toolbox™.

3rd Party Products:

  • For OpenAI connections: An active OpenAI API subscription and API key.
  • For Azure OpenAI Services: An active Azure subscription with OpenAI access, deployment, and API key.
  • For Ollama: An Ollama installation.

Setup

See these pages for instructions specific to the 3rd party product selected:

  • OpenAI
  • Azure
  • Ollama

MATLAB Online

To use this repository with MATLAB Online, click Open in MATLAB Online

MATLAB Desktop

To use this repository with a local installation of MATLAB, first clone the repository.

  1. In the system command prompt, run:

    git clone https://github.com/matlab-deep-learning/llms-with-matlab.git
    
  2. Open MATLAB and navigate to the directory where you cloned the repository.

  3. Add the directory to the MATLAB path.

    addpath('path/to/llms-with-matlab');
    

Examples

To learn how to use this in your workflows, see Examples.

  • ProcessGeneratedTextinRealTimebyUsingChatGPTinStreamingMode.md: Learn to implement a simple chat that stream the response.
  • SummarizeLargeDocumentsUsingChatGPTandMATLAB.md: Learn to create concise summaries of long texts with ChatGPT. (Requires Text Analytics Toolbox™)
  • CreateSimpleChatBot.md: Build a conversational chatbot capable of handling various dialogue scenarios using ChatGPT. (Requires Text Analytics Toolbox)
  • AnalyzeScientificPapersUsingFunctionCalls.md: Learn how to create agents capable of executing MATLAB functions.
  • AnalyzeTextDataUsingParallelFunctionCallwithChatGPT.md: Learn how to take advantage of parallel function calling.
  • RetrievalAugmentedGenerationUsingChatGPTandMATLAB.md: Learn about retrieval augmented generation with a simple use case. (Requires Text Analytics Toolbox™)
  • DescribeImagesUsingChatGPT.md: Learn how to use GPT-4 Turbo with Vision to understand the content of an image.
  • AnalyzeSentimentinTextUsingChatGPTinJSONMode.md: Learn how to use JSON mode in chat completions
  • UsingDALLEToEditImages.md: Learn how to generate images
  • UsingDALLEToGenerateImages.md: Create variations of images and editimages.

License

The license is available in the license.txt file in this GitHub repository.

Community Support

MATLAB Central

Copyright 2023-2024 The MathWorks, Inc.