spark-LDA-example icon indicating copy to clipboard operation
spark-LDA-example copied to clipboard

Published 20 hours ago • verified publisher icon shiv4nsh
→

Metadata

A simple Spark LDA example. to demonstrate a full fletched clustering algorithm, with data cleaning using the processess like lemmatization , stemming etc.

Results 1 spark-LDA-example issues
Sort by recently updated
recently updated
newest added

OutOfMemory

Hi Shivansh when i run your code on my documents (they are 20000 texts and 12500 characters for each one) with even 12g ram i get out of memory error....

iamchandler avatar iamchandler

← Metadata

23
Stars
9
Forks
Watchers

Owner

verified publisher icon shiv4nsh

Metadata

A simple Spark LDA example. to demonstrate a full fletched clustering algorithm, with data cleaning using the processess like lemmatization , stemming etc.

Back