BERTopic icon indicating copy to clipboard operation
BERTopic copied to clipboard

Can we save generated topic model directly to s3 ?

Open reichenbch opened this issue 2 years ago • 1 comments

I have a use-case where I am creating topic model out of given data and want to store to topic model directly to s3 due to memory constraints on the running the service on AWS Lambda.

Any help or idea would help. I tried the pickle approach and directory approach to save the model on s3. Pickle approach throws error and directory approach shows success but doesn't upload anything (show success in Jupyter Notebook, no error thrown)

reichenbch avatar Jan 17 '24 12:01 reichenbch

There isn't an option to do this directly but you can always just move the resulting files yourself if you have access to the storage, ports are open, etc.

MaartenGr avatar Jan 18 '24 06:01 MaartenGr