Eric Hanson

Results 405 comments of Eric Hanson

BTW, to choose the tolerance, given the 4 encoding parameters as Float64, we can actually compute the error in roundtripped sample (after encoding & decoding with rounded values) and choose...

@ararslan would love to know your thoughts here!

> Can you sketch what this does, for people who don't know anything about Arrow? The purpose is similar to StructTypes.jl if you are familiar with that. It is to...

We don’t; StructTypes is designed around JSON afaik and it not expressive enough in that it can’t capture the metadata that makes roundtripping nested objects work smoothly. I don’t know...

One thought it that weak dependencies / package extensions might make adding arrowtypes definitions 0-cost here. That would be 1.9-only or need Requires.jl for pre-1.9 support.

I took a look at it, but with mutable `Leaf`’s with meaningful object identity, I’m not sure there’s a reliable way to do it at the level of an individual...

What other serialization backends would be useful BTW? LightBSON via StructTypes? Something else also?

For the norm use-case, another thing that would be handy is if I could `destructure` the gradient to flatten it, but only keep the trainable params as governed by the...

ah yeah, this is tricky. I think https://github.com/ericphanson/ExplicitImports.jl/pull/28 could help here. In that PR I track things a bit better so I think I could handle this.

#50 adds the technology needed for the second case, but it isn't exposed to the user yet.