Mehran Maghoumi comments

Results 26 comments of


                                            Mehran Maghoumi

tutorials/peft-curation-with-sdg Failing with Runtime Exceptions.

> Thank you for the instructions, i tried installing based on your steps I'm getting a different error now: OSError: libcudart.so: cannot open shared object file: No such file or...

tutorials/peft-curation-with-sdg Failing with Runtime Exceptions.

Glad to hear that you were able to follow along after using another environment. Regarding your questions: > Looks like synthetic data generation not possible without an API key, could...

tutorials/peft-curation-with-sdg Failing with Runtime Exceptions.

Hi @praxi-roshan, let me know the status of this issue, and whether we are good to close it. Also, I also opened a new PR to improve the documentation for...

[BUG] Fuzzy deduplication fails on datasets with no duplicates

@ayushdg I heard @praateekmahajan saying he's not having this issue on his end. I just pulled the latest main branch to confirm, but I still have this error: ``` $...

Unexpected performance degradation behavior in minhash deduplication stage 2

Thanks for your responses here and in the other non-public channels. > The main factor not captured by the complexity here on T is that with an increase of T...

Create `Cache` class for exact, fuzzy, and semantic deduplication

Thanks so much for working on this change. What I like about this now is that it gives users the option to either use the same cache directory for anything...