blldd

Hi Jie, thank you for sharing. I have two questions about the dataset: - how to generate the tweets_clean.txt - and what's the meaning of each filed in tweets_clean.txt Thank...

How can i get embedding between 0-1?

4

Hi, i have got some problem when i want to get embedding between 0 and 1, even when i initialize between 0 and 1, it doesn't work, how should i...

I run this code in my PC, and there is the errro info: Using a generator with `use_multiprocessing=True` is not supported on Windows So, I changed the parameter in fit_generator...

It seems that lora does not work

7

When I run step1_supervised_finetuning, I found that the memory of the opt-1.3B model occupies about 15G, as if lora does not work, but when I print the trainable parameters, it...

Does it support lora and pipeline parallel now?

3

I found that the memory usage is very large even when using zero3 and lora, so I was wondering whether can I support pipeline parallelism or Tensor parallelism?

the memory usage of zero3 is larger than zero1

1

When I run the step1_supervised_finetuning script, I find that the memory usage of zero3 is larger than that of zero1, which seems unreasonable. Is there any other optimization here?

Hi, thanks for your great work. I have a question on how to limit the degree of warp, as I have observed that the skirt is being warped and stretched...

Hi, thanks for your great work! When I try the _test/test.py_ , I find that the repair effect is better in the bass area, but has no effect in the...

RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation

9

HI, very lucky to study your repo, unfortunately, I encountered an error while running the code as follows: ------ parse with gowalla default settings use device: cpu Split.TRAIN load 7768...