Lukasz Stafiniak
Lukasz Stafiniak
Axis labels are verbose, especially in the einsum notation. Positional representation has a long tradition in mathematics e.g. linear algebra. In shape inference, it's hard, maybe impossible, to come up...
Introduce a record type e.g. `dimensions` combining number of dimensions with a units string (formerly label). Update the syntax extensions to work freely with `dimensions` values. Maybe make units obligatory!
It's from Answer.AI (Jeremy Howard's new company). Sources: - https://x.com/jeremyphoward/status/1869786023963832509 - https://huggingface.co/blog/modernbert - https://arxiv.org/abs/2412.13663
In particular when it's set manually, or behind the scenes for #293.
I'm about to remove the restriction where events are created only once they are first queried for a node / stream. Conceptually this is a nice optimization, but the overhead...
Current implementation was written with memory mode sharing inference in mind, so high chances it's not working when e.g. a node is specified as shared but modified from multiple streams....
Currently this is very broken and confused, e.g. the cuda backend always uses it when merging by-copy.
Using `cu_mem_get_info` gives results that are not very meaningful. For example: ``` ┌─────────────────────────────────────────────────────────────────────────────────────────┬───────────┬───────────────┬───────┬─────────┬───────────────────────────────────────────────────┐ │Benchmarks │Time in sec│Memory in bytes│Speedup│Mem gain │init time in sec, min loss, last loss │ ├─────────────────────────────────────────────────────────────────────────────────────────┼───────────┼───────────────┼───────┼─────────┼───────────────────────────────────────────────────┤...