Cache Requests

Open diptanu opened this issue 8 months ago • 2 comments

Cache the I/O of functions if the code version and the Inputs are same. Provide flags to override cache by the user.

Apr 09 '25 15:04 diptanu

When invoking we probably want something like this:

cache=CachingStrategy.Payload

We should also add some type of Idempotency Key, Id or Token support in our invocation to prevent running the same invocation at the same time similar to Temporal does it.

Apr 11 '25 20:04 seriousben

This should stay open until tensorlakeai/tensorlake#110 lands.

May 07 '25 22:05 earhart