dbt-starrocks icon indicating copy to clipboard operation
dbt-starrocks copied to clipboard

Make retry logic configurable

Open svdimchenko opened this issue 2 months ago • 1 comments

The root cause is here: https://github.com/StarRocks/dbt-starrocks/blob/115558492edb8e4ffa9d7db8faf8c8f254f34961/dbt/adapters/starrocks/impl.py#L141

If the model is not complete within 512 seconds (~8 minutes), we need to wait for 1024 seconds more (+16 minutes). So the total time to wait will be ~25 minutes 🕦. Seems not so flexible and if we add kind of random backoff logic (can be configurable), the real dbt model materialisation will be much faster. The backoff logic config may be moved to dbt_profiles.yml as it's for instance in dbt-athena.

svdimchenko avatar Oct 23 '25 20:10 svdimchenko

@svdimchenko We will be very glad if you can submit a improvement PR for it. And, what is you recommendation for the backoff logic?

jaogoy avatar Nov 21 '25 08:11 jaogoy