Temporal: Input Exceeds Size Limit While Running Tasks With Large Data

[HamadaSalhab]

trafficstars

Description

When sending large data in a task execution workflow, the execution is failing, and updating the execution with new data returns 500 Server Error: Internal Server Error.

Reproduce

Download this notebook and run it locally (multi-tenant mode).

Logs

INFO:temporalio.workflow:Processing outcome for step 5 ({'attempt': 1, 'namespace': 'default', 'run_id': '2365525b-acf4-47b9-85a7-420bfc81cb6f', 'task_queue': 'julep-task-queue', 'workflow_id': 'ef7c4f9b-139f-4ba2-af1d-f0db3111ea43', 'workflow_type': 'TaskExecutionWorkflow'})
INFO:temporalio.workflow:Wait for input step: Waiting for external input ({'attempt': 1, 'namespace': 'default', 'run_id': '2365525b-acf4-47b9-85a7-420bfc81cb6f', 'task_queue': 'julep-task-queue', 'workflow_id': 'ef7c4f9b-139f-4ba2-af1d-f0db3111ea43', 'workflow_type': 'TaskExecutionWorkflow'})
INFO:temporalio.workflow:Transitioning after step 5 ({'attempt': 1, 'namespace': 'default', 'run_id': '2365525b-acf4-47b9-85a7-420bfc81cb6f', 'task_queue': 'julep-task-queue', 'workflow_id': 'ef7c4f9b-139f-4ba2-af1d-f0db3111ea43', 'workflow_type': 'TaskExecutionWorkflow'})
2024-10-03T15:01:18.994187Z  WARN temporal_sdk_core::worker::workflow: Error while completing workflow activation error=status: InvalidArgument, message: "BadScheduleActivityAttributes: ScheduleActivityTaskCommandAttributes.Input exceeds size limit.", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc"} }