eventual icon indicating copy to clipboard operation
eventual copied to clipboard

Reference Based result payloads

Open thantos opened this issue 3 years ago • 1 comments

Data returned from activities and workflows may be larger than can we stored in dynamo and sqs.

  • Save values into s3, dynamo, or inline using an abstracted client based on size.
  • Dereference result values as needed for the workflow to operate. Dereference into s3 for workflow access.

thantos avatar Nov 14 '22 14:11 thantos

I think this is high priority. Passing data around through workflows is super important. @yehudacohen has been pushing for this also.

While building out an example, I found myself wanting something like this:

const getMyData = activity("getMyData", async () => {
  const myData = new JsonRef<MyPayloadType>(myPayload);

  return myData;
});

sam-goodwin avatar Feb 27 '23 00:02 sam-goodwin