taipy icon indicating copy to clipboard operation
taipy copied to clipboard

Implement Caching for Unchanged Data Nodes

Open FlorianJacta opened this issue 1 year ago • 2 comments

Description

Summary:
Improve performance by caching data nodes that haven't changed since their last read. Subsequent reads could retrieve data from the cache instead of the original storage, speeding up access and improving application efficiency.

Details:

  • Cache only applies to unchanged data nodes.
  • Invalidate cache on data modification.
  • Optional for supported storage types.

Benefits:

  • Faster data access.
  • Reduced I/O operations.
  • Simplified application development.

This feature would significantly enhance performance for frequently accessed data nodes.

Acceptance Criteria

  • [ ] Ensure new code is unit tested, and check code coverage is at least 90%.
  • [ ] Propagate any change on the demos and run all of them to ensure there is no breaking change.
  • [ ] Ensure any change is well documented.

Code of Conduct

  • [X] I have checked the existing issues.
  • [ ] I am willing to work on this issue (optional)

FlorianJacta avatar Aug 13 '24 08:08 FlorianJacta

Can you provide a dataset with a reference time, so we can monitor if the cache implementation actually improve the performance or not?

jrobinAV avatar Aug 21 '24 12:08 jrobinAV

Depends on taipy-benchmark results.

jrobinAV avatar Aug 23 '24 08:08 jrobinAV