Umar Butler comments

Results 114 comments of


                                            Umar Butler

Slower than absolute positional embeddings?

In the end, I managed to significantly reduce the time spent on rotary embeddings by caching cos and sin values, cutting out lots of code that was unnecessary for my...

New option called `"best"` for `args.save_strategy`.

If `load_best_model_at_end = True`, the strategy cannot be set to `best`.

New option called `"best"` for `args.save_strategy`.

This solves https://github.com/huggingface/transformers/issues/35070, cheers! 🥳

Print out progress/estimate of remaining time

Python 3.12 wheel

I would recommend checking out [OnnxSlim](https://github.com/tsingmicro-toolchain/OnnxSlim). I was able to install it on Python 3.12 without any issues.

flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol

Pylance has crashed. Would you like to try using a Node.js executable to run the language server?

+1 Pylance has been crashing and short circuiting much more than normal and I am now getting the error 'Pylance has crashed. Would you like to try using a Node.js...

Pylance has crashed. Would you like to try using a Node.js executable to run the language server?

For others who have been experiencing this issue, it seems to correlate with the release of `2024.7.1`, so I have downgraded to `2024.6.1`.

Pylance has crashed. Would you like to try using a Node.js executable to run the language server?

I have 64GB of RAM.