disco icon indicating copy to clipboard operation
disco copied to clipboard

Benchmark gpt-tfjs integration

Open JulienVig opened this issue 1 year ago • 0 comments

Benchmark and report some information on what to expect and the row for improvement:

  • [ ] number of training iterations needed on an example dataset, expected loss/perplexity, example of text generation after training
  • [ ] number of tokens/sec
  • [ ] model sizes
  • [ ] memory requirements
  • [ ] compare numbers with ONNX

#656 should be addressed first

JulienVig avatar Apr 03 '24 11:04 JulienVig