OpenCRE
OpenCRE copied to clipboard
Prune map analysis search to save time and memory
Map analysis takes days to calculate and gigabytes to store, but we're only interested in the top matches from standard to standard. It's no use to find 100 weakly linked topics if you have a couple of direct links and a number of strong links. The idea therefore is to prune the search we do for map analysis, by stopping search early if we know that we're looking
- design a strategy for pruning. First stab: don't search for average and weak links if we have direct and strong links. Don't search for weak links if we have direct, strong or average links'.
- update the search algorithm. This will require some smartness, depending on how it is implemented.
By the way, I notice we don't seem to have weak links anymore: should we change our categorization and make 3-6 average and 7+ weak?
First step: find expertise in Neo4J. Rob