concurrent-trees icon indicating copy to clipboard operation
concurrent-trees copied to clipboard

question

Open publicocean0 opened this issue 7 years ago • 3 comments

is there a way for saving the index to disk or different storage ?

if all the suffix tree is too much big is there a way for loading a part dinamically?

publicocean0 avatar Oct 17 '17 20:10 publicocean0

I'm afraid there's not a way to save or page in/page out the tree to disk in a way that it can be accessed. (You can serialize the tree, but this won't help with reducing runtime memory)

Have you tried using a CharSequenceNodeFactory with the suffix tree? This is the best way to reduce runtime memory overhead for the suffix tree.

Sent from my Android

On 17 Oct 2017 21:45, "publicocean0" [email protected] wrote:

is there a way for saving the index to disk or different storage ?

if all the suffix tree is too much big is there a way for loading a part dinamically?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/npgall/concurrent-trees/issues/28, or mute the thread https://github.com/notifications/unsubscribe-auth/ACuJioT7M6xYQOmRFXKQqU_pYfQxsFEnks5stRHygaJpZM4P8y5P .

npgall avatar Oct 17 '17 21:10 npgall

ideally i had thought to visit the tree in inorder way. and save it. The tree is saved in way that every subtree is saved in a unique block. every block is in format sizeof block and data in recursive way. I consider the tree in memory is too much big so i cant load all,but every node contains a pointer to file position . when a subtree is not loaded in the search , you can load the partial subtree with a direct access to file. The part always in memory contains the first levels of the tree.

publicocean0 avatar Oct 17 '17 22:10 publicocean0

it was a good idea if the tree is not modifiable .... essentially you are right there no way to create a storage version fastly updatable in any sub-part ... the just way is key-value form removing any peristence advantage for trees.

publicocean0 avatar Oct 18 '17 09:10 publicocean0