kubernetes-engine-samples icon indicating copy to clipboard operation
kubernetes-engine-samples copied to clipboard

Increase the memory for the example for the 7b model to load properly

Open kenthua opened this issue 7 months ago • 0 comments

Description

Loading this model requires additional memory

Tasks

  • [x] The contributing guide has been read and followed.
  • [x] The samples added / modified have been fully tested.
  • [ ] Workflow files have been added / modified, if applicable.
  • [ ] Region tags have been properly added, if new samples.
  • [ ] All dependencies are set to up-to-date versions, as applicable.

kenthua avatar Jul 03 '24 19:07 kenthua