Anjor Kanekar

Wrote something in go: https://github.com/anjor/unixfs-cat/blob/main/unixfs_cat.go Happy to work more on it if it's useful/along the lines of the thinking here.

I am on board with the design. Do we want to make the changes as a big bag, or piecemeal? We should make sure that we are not breaking existing...

Directionally on board with this change. I think we are at a stage where we could start a PR at this point, and people can comment about specific implementation on...

All good, thanks for the comments. Your suggestions sounds good, I will get that implemented. Any ideas on what to call the intermediate layer?

Sorry have been a bit occupied with some other stuff. Hoping to get to this soon.

This has been a very interesting conversation, thank you @veekaybee @haileyschoelkopf . On a separate but related note, @haileyschoelkopf do you know how exactly does OpenAI run these benchmarks? Surely...

There is this effort to handle the different chat formats and conversions in between -- https://github.com/deployradiant/pychatml

Is this PR related -- https://github.com/EleutherAI/lm-evaluation-harness/pull/943 ?

@haileyschoelkopf the gsm8k is what I was asking about in discord the other day.

This is a great question and certainly something that has come up in slack before. The permissions model in estuary doesn't have that much granularity. The different levels of permissions...