xlearn icon indicating copy to clipboard operation
xlearn copied to clipboard

Binary learning with --disk learning

Open 4ound opened this issue 4 years ago • 1 comments

Hey! We have big dataset for training (few TB), so we use your library with --disk learning option. We spend significant time on dataset parsing. On practice, if generate binary file and start RAM learning (with --no-bin and without), second variant would be faster. While on disk mode doesn't use/generate binary file, why?

4ound avatar Aug 14 '19 20:08 4ound

@4ound The binary file could beyond you RAM capability, so we only generate binary file for in-memory training.

aksnzhy avatar Aug 15 '19 03:08 aksnzhy