tensor_parallel icon indicating copy to clipboard operation
tensor_parallel copied to clipboard
verified publisher icon BlackSamorez

Add more predefined configs

Open BlackSamorez opened this issue 2 years ago • 0 comments

We could use more predefined configs for better user experience. Models to consider:

  • [x] bert
  • [x] gpt2
  • [ ] LLaMa
  • [ ] electra
  • [ ] something else

BlackSamorez avatar Feb 24 '23 17:02 BlackSamorez