make backoffLimit configurable for jobs

[jenshu]

Version

1.11.x

Is your feature request related to a problem? Please describe.

We should consider making backoffLimit configurable for all the jobs in our helm charts. The default value is 6 but some customers prefer to limit the number of retries.

Describe the solution you'd like

We could add a backoffLimit field to the JobSpec

When we add this, it might also be a good idea to refactor the job templates to use a helper function to set all the job spec fields, similar to what we do with pod spec fields

Describe alternatives you've considered

No response

Additional Context

No response