data-curator
data-curator copied to clipboard
Review software libraries to simplify repo
review use of
- jquery
- streaming vs in-memory
- dropping unused testing libraries
Update README.md to reflect changes
Hi @Stephen-Gates Have removed:
- jQuery and jQuery-csv use. (and the bootstrap-js that relies on jQuery) - bootstrap4 doesn't seem to me to have anything significant that we need, but for future reference if there is a useful boostrap javascript component, Boostrap-native I think is a good fit - all of boostrap-js but with native javascript, which it claims is faster than jQuery equivalent.
- redundant testing and other libraries (hangovers from various pocs we did along the way)
Streaming is still on the TODO - perhaps re-open this or add as a new issue. I think it may also be related to potential issues with opening multiple tabs with significant (10 000+) rows. Atm, while we have swapped out jQuery-csv for the same 'fast' csv library that frictionless use, the data is still being 'copied' from array to string and vice versa when moving to and from files. Not sure off the top of my head yet, but if we could find a way to stream this instead of loading everything then this will help. Related to this are:
- pipeline for handsontable to render individual cells, rather than the whole table
- scrolling and lazy loading of data
- Paul I think raised an issue where switching between tabs was slow once significant data introduced
- I'd also like to start looking at use of memory in dev, to detect whether there are perhaps objects, or more likely listeners that are hanging on that maybe are no longer needed. I've tried to hand-off as much of this as possible to vue and vue-related libraries that take care of this for us (ie: closing to avoid memory leaks), but there may still be spots where this is an issue. I know that you have found these issue links somewhere ;) - (but don't have them handy) so will add once you or I find them