Lukasz Stafiniak comments

Results 116 comments of


                                            Lukasz Stafiniak

Consider: Refactor / rewrite gradient management from storing backprop computations to storing backprop tensors

Let's suspend this for now as this is a departure from the original OCANNL design, maybe stupid but let's see first... What might be interesting is to add support for...

Unreadable text with Dark High Contrast color theme

Could we get some progress on this? Problem: How it's rendered by VS Code renderer, so expecting it should render this way in the Cline window:

Unreadable text with Dark High Contrast color theme

For other Dark High Contrast users who stumble here, check out the themes: Abyss and Red. They have better contrast than other default dark themes.

Unreadable text with Dark High Contrast color theme

The light high contrast theme is also broken:

[BUG] dune build @check fails mysteriously with overlapping executables

One also gets this behavior when `modules` fields are missing altogether from `executable` and `test` stanzas.

Highlight propagation sometimes skips over one node

Sometimes over multiple nodes:

Deep dive into the Megakernel approach since it's well aligned with OCANNL design

https://github.com/mirage-project/mirage/tree/mpk https://zhihaojia.medium.com/compiling-llms-into-a-megakernel-a-path-to-low-latency-inference-cf7840913c17 https://x.com/JiaZhihao/status/1935767958963314773

Deep dive into the Megakernel approach since it's well aligned with OCANNL design

Because splitting of megakernels into proper kernels is not implemented yet.

Deep dive into the Megakernel approach since it's well aligned with OCANNL design

Less tongue-in-cheek: megakernel = routine in OCANNL terminology.

Implement loop hoisting (loop-invariant code motion), prior to vistit counting (the semi-concrete interpretation run)

This entails changing the `fix`-style construct in `Low_level` to a `let rec`-style construct, since the latter is more general.