horta-hell
horta-hell copied to clipboard
Decrease Markov network memory footprint
trafficstars
I believe that currently Markov network images are consuming more memory that it's needed for them. We need to profile Horta memory and decrease network memory footprint if that's possible.
Please first of all check #134 when implementing.
Some optimization points (things to consider):
- Intern strings (words) after parsing the file.
- Intern phrase vectors inside Platonus library.
- Make a single parser actor (so it won't eat too much memory while parsing multiple networks at once).
- Progressively load strings from the database (don't load them all at once).