Behaviour Mismatch between ggml_opt in Native Program and WASM

[saraalrawi]

In my implementation, I try to optimize a model using Adam optimizer. Namely, GGML_OPT_TYPE_ADAM when the grads differ when the code runs as a native program than the code compiled to WASM using Emscripten.

The forward pass is similar, but the grads are not equal.

Could you please look at this issue? I would appreciate it if any contributor has a similar issue and can share his experience.