ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: how much storage space do you take for embedding? i just embedding about 2 QA datasets about 150MB , it take nearly 90GB stoage , it is normal ?

Open micjac99 opened this issue 11 months ago • 2 comments

Describe your problem

Image

Image

Ragflow0.16, Chunk Method :QA , embedding model : nomic-embed-text , dataset: Surgical_QA_all.csv + QA_Andrology.csv i just embedding about 2 QA datasets about 150MB , it take nearly 90GB stoage , it is normal ?

I WANT TO SEE YOURS FOR REFERENCE

micjac99 avatar Feb 18 '25 19:02 micjac99

Check the Mysql binlog. Maybe, that's the reason.

KevinHuSh avatar Feb 19 '25 05:02 KevinHuSh

Check the Mysql binlog. Maybe, that's the reason.

thks , so many logs , prune the log , storage free up 77GB.

Image

micjac99 avatar Feb 19 '25 08:02 micjac99