clip-as-service icon indicating copy to clipboard operation
clip-as-service copied to clipboard

Specify Model to use

Open RaiAmanRai opened this issue 2 years ago • 1 comments

How can I specify what model to use. I have seen the documentation specifying which model is supported for pytorch, onnx and tensorrt, but there is no documentation for changing them.

@ZiniuYu any help on this!

RaiAmanRai avatar Aug 10 '22 06:08 RaiAmanRai

Hi @RaiAmanRai , you may take a look here and here For example,

jtype: Flow
version: '1'
with:
  port: 51000
executors:
  - name: clip_t
    uses:
      jtype: CLIPEncoder
      metas:
        py_modules:
          - clip_server.executors.clip_torch
    uses_with:
      name: 'RN101::openai'

ZiniuYu avatar Aug 10 '22 07:08 ZiniuYu

Figured it out, thanks for the quick response @ZiniuYu

RaiAmanRai avatar Aug 10 '22 13:08 RaiAmanRai