Out of memory - What are sensible upper bounds?

[the42]

I am using the NLP package for similarity search.

Input is a corpus of 300000 entries of []string, each consisting of about 10-50 words.

When I naively follow the example https://pkg.go.dev/github.com/james-bowman/nlp#example-package , this panics with Out of Memory.

I reduced the set to 10000 entries and FitTransform takes a very long time on my laptop (Minutes) to complete.

Am I doing something wrong or is this task not the correct way of using this package?