ludwig icon indicating copy to clipboard operation
ludwig copied to clipboard

[WIP] Create a binary decoder with a TART reasoning module

Open jeffkinnison opened this issue 1 year ago • 3 comments

This adds a TART reasoning module as a binary decoder.

TODOs:

[] Add the vanilla and LOO embedding protocols [] Add an embeddings cache [] Tests

jeffkinnison avatar Oct 13 '23 21:10 jeffkinnison

Unit Test Results

  6 files  ±0    6 suites  ±0   20m 46s :stopwatch: -22s 12 tests ±0    9 :heavy_check_mark: ±0    3 :zzz: ±0  0 :x: ±0  60 runs  ±0  42 :heavy_check_mark: ±0  18 :zzz: ±0  0 :x: ±0 

Results for commit 2c28ac80. ± Comparison against base commit b6bdf9c8.

github-actions[bot] avatar Oct 13 '23 22:10 github-actions[bot]

@jeffkinnison can we pass the tokenizer in to the embedding protocols?

ANarayan avatar Oct 17 '23 03:10 ANarayan

@ANarayan Let's assume that we can pass in the tokenizer and model into the protocol functions. That should simplify initial development, and we can revisit that design if needed. Also, feel free to update the function signatures or convert them into classes, or to make any other changes!

jeffkinnison avatar Oct 20 '23 17:10 jeffkinnison