brickflow icon indicating copy to clipboard operation
brickflow copied to clipboard

[FEATURE] Increase task limit for workflows to 200

Open shwen-gine opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe. Databricks team have increased the task limit to 200 for react workspace. It would be helpful to have this feature supported in brickflow.

Cloud Information

  • [x] AWS
  • [ ] Azure
  • [ ] GCP
  • [ ] Other

Describe the solution you'd like Update the max_tasks_in_workflow variable to 200 image

Describe alternatives you've considered

Additional context Currently, brickflow throws the following error image

shwen-gine avatar May 27 '24 15:05 shwen-gine

@shwen-gine can you try to override it in your code as it is mentioned in the comment. Thanks!

asingamaneni avatar Oct 03 '24 13:10 asingamaneni

Wont't fix this as it is a Databricks limit

riccamini avatar Jan 14 '25 09:01 riccamini