cerebros-core-algorithm-alpha icon indicating copy to clipboard operation
cerebros-core-algorithm-alpha copied to clipboard

first-pass-optimization-of-pico-scale-generative-model-0001

Open david-thrower opened this issue 2 months ago • 1 comments

From #212 (Optimizations to proof of concept generative model)

  • [x] Manual first pass optimizations of the projection layers after the embedding. (e.g. parameterize it)
  • [x] Fix logic for handling text samples with no token
  • [x] Add more training data
  • [x] load more text samples and capture the curve between samples and perplexity

david-thrower avatar Sep 13 '25 03:09 david-thrower