koala
koala copied to clipboard
Explore the idea of pure functional evaluation
This is to avoid to eval()
at each node of the graph, which takes quite a long time.
Two ideas were tested:
- create a single formula string. This idea works on small excel files, but consumes too much memory for large files. This might not be relevant anymore.
-
pure functional evaluation. Most of the code has been modified, but it doesn't work yet. Some refactoring might be necessary => propagate the function results from
sp.set_value(input, value)
rather than call the uppermost function (withsp.evaluate(output)
)
After some testings, it is not proven that this idea will reduce our eval timings:
- on a small file, eval were slightly higher
- what we might save not using
eval
, we will probably waste loading the functions withmarshal
util
But most of all, it does not seem possible to load our function from gzip
, since they are not pure functions...