Ayush Dattagupta comments

Results 83 comments of


                                            Ayush Dattagupta

import cudf will cause CUDARuntime error

Thanks for raising! It looks like you're using CPU modules for now on a machine which might have an older GPU resulting in errors about cudf imports. If you don't...

import cudf will cause CUDARuntime error

Thanks for looking into this. In typical cases if no GPU was detected we would throw an importError, but it looks something in the import chain recognizes: `VGA compatible controller:...

import cudf will cause CUDARuntime error

@2518298329 Feel free to re-open if you're still running into this issue.

Initial slurm deployment scripts

@lbliii Could you point me to where I should also update this in the docs?

Initial slurm deployment scripts

@sarahyurick jfyi one thing I observed from the timeouts is that it always hangs right after the url_generation tests for wiki before timing out vs in successful runs the suite...

Please add tutorial notebooks that demonstrate Exact deduplication and Fuzzy deduplication

Thanks for opening. The tutorials are something we're working on and will open a PR for soon. > The documentation suggests using the [TextDuplicatesRemovalWorkflow](https://docs.nvidia.com/nemo/curator/25.09/curate-text/process-data/deduplication/index.html#text-process-data-dedup-common-ops) for removing duplicates, but the information...

Please add tutorial notebooks that demonstrate Exact deduplication and Fuzzy deduplication

Starting adding this in #1242. Will followup with Exact in a different PR.

Ayush Dattagupta

Bump xenna to latest version

Bump xenna to latest version

Bump xenna to latest version

import cudf will cause CUDARuntime error

import cudf will cause CUDARuntime error

import cudf will cause CUDARuntime error

Initial slurm deployment scripts

Initial slurm deployment scripts

Please add tutorial notebooks that demonstrate Exact deduplication and Fuzzy deduplication

Please add tutorial notebooks that demonstrate Exact deduplication and Fuzzy deduplication