[WORKFLOW SDK FEATURE REQUEST] Address many gotchas in workflow activities RetryPolicy

[passuied]

Describe the WORKFLOW SDK feature

There are multiple gotchas in the workflow activity retry policies as described below:

ACTIVITY_RETRY_POLICY = RetryPolicy(
    first_retry_interval=timedelta(seconds=1),
    
   # max_number_of_attempts is the total attempt count, not the retry count
    max_number_of_attempts=5,
    backoff_coefficient=3,
   
    # Set max_retry_interval else there won't be any retries
    max_retry_interval=timedelta(seconds=10),
   
    # DON'T set retry_timeout. If the timeout is hit, the entire workflow fails and the
    # final activity isn't executed.
)

Release Note

RELEASE NOTE: ADD Address multiple gotchas in the workflow activity retry policies.

[dapr-bot]

This issue has been automatically marked as stale because it has not had activity in the last 60 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue, help wanted or triaged/resolved) or other activity occurs. Thank you for your contributions.

[filintod]

one bug mentioned here is being fixed in https://github.com/dapr/durabletask-python/pull/33. Also the README.md in that PR mentions some of the information on the gotchas above, but it might be good to bring those to the docs here

@passuied please check this PR readme for comments https://github.com/dapr/durabletask-python/pull/33/commits/d9ed06e839cc597e4c11b298ea7a49ad3df19b9e#diff-b335630551682c19a781afebcf4d07bf978fb1f8ac04c6bf87428ed5106870f5