BERTopic
BERTopic copied to clipboard
Can we save generated topic model directly to s3 ?
I have a use-case where I am creating topic model out of given data and want to store to topic model directly to s3 due to memory constraints on the running the service on AWS Lambda.
Any help or idea would help. I tried the pickle approach and directory approach to save the model on s3. Pickle approach throws error and directory approach shows success but doesn't upload anything (show success in Jupyter Notebook, no error thrown)
There isn't an option to do this directly but you can always just move the resulting files yourself if you have access to the storage, ports are open, etc.