pearai-extension icon indicating copy to clipboard operation
pearai-extension copied to clipboard

Published 20 hours ago • verified publisher icon trypear

WIP - TabAutoComplete

Open Ellahinator opened this issue 1 year ago • 0 comments

Description

  • Addresses https://github.com/trypear/pearai-app/issues/249
  • Related PR https://github.com/trypear/pearai-server/pull/131

got something really scuffed in the works. added the starcoder2 api endpoint (hosted by huggingface) to our server. can change tabAutocompleteModel to use pearai-server. calls the endpoint fine. am figuring out how to properly receive the data in the right format to the app. with this we can invoke codestral or other models in the future in our server. its really scuffed atm. i also got codestral working (if user provides their own api key in the tabautocompletemodel config) but was facing rate limiting errors from mistrals API (free API rate limit is 1/s).

Facing some trouble implementing this. Would like some assistance!

modify config.json to test

  "tabAutocompleteModel": {
    "title": "HF Starcoder2 3b",
    "provider": "pearai-server",
    "model": "pearai-latest"
  },

Ellahinator avatar Aug 10 '24 03:08 Ellahinator