[FEATURE]: Add retry and restart events in workflow publisher

[JCHacking]

Please read our contributor guide before creating an issue.
Also consider discussing your idea on the discussion forum first.

Describe the Feature Request

I have added the following configuration to my driver:

conductor.workflow-status-listener.type=workflow_publisher
conductor.status-notifier.notification.url=http://localhost:8000/webhook/conductor
conductor.status-notifier.notification.endpointWorkflow=/workflow

And I would like to be notified with other changes that do not end the workflow.

Right now, as far as I have been able to see, it only notifies when a workflow is finished or completed.

Describe Preferred Solution

Add the rest of events to make driver integrations more reactive. Additionally it could be worth adding in the settings to choose which events you want to subscribe to or something like that.

Describe Alternatives

I can't think of any other alternatives for this feature

[Robban1980]

@JCHacking could the PR that was merged yesterday adding kafka support to the workflow-status-listener and some new events described here https://github.com/conductor-oss/conductor/tree/main/workflow-event-listener#kafka-publisher work? The new events were only added to Kafka to avoid breaking backwards compatibility.

[JCHacking]

@JCHacking could the PR that was merged yesterday adding kafka support to the workflow-status-listener and some new events described here https://github.com/conductor-oss/conductor/tree/main/workflow-event-listener#kafka-publisher work? The new events were only added to Kafka to avoid breaking backwards compatibility.

Yes, if these events are also added to statuschange it should work.

Maybe we should add several more of them to improve this notification system.