elementary icon indicating copy to clipboard operation
elementary copied to clipboard

[ELE-169] Ci in github actions takes too long

Open InbarShirizly opened this issue 2 years ago • 4 comments

Describe the bug I can see that the CI flow of elementary takes me 12-13 min, which was 2-3 min before

Expected behavior faster execution

Screenshots image image

Environment (please complete the following information):

  • edr Version: 0.6.5, can be found by running pip show elementary-data
  • dbt package Version: 1.3.2, can be found in packages.yml file

I think that EDR is running the models over and over in the commands:

  • edr monitor --slack-token
  • edr monitor report --file-path report.html
  • edr monitor send-report

which is wasting time

@elongl

ELE-169

InbarShirizly avatar Jan 11 '23 16:01 InbarShirizly

Thanks for reporting @InbarShirizly! can you please share the edr.log and workflow log so we can see which part specifically is taking most of the time?

oravi avatar Jan 11 '23 16:01 oravi

logs_110.zip edr.log.zip

adding here the edr.log and the logs of the specific workflow, it is actually hard to understand what specifically is slow, looks like just the full process became slower in each step @oravi

InbarShirizly avatar Jan 11 '23 17:01 InbarShirizly

Any update here? it takes now 25 minutes to finish, not clear to me what is going on

some models take more than 3 minutes

image

InbarShirizly avatar Jan 15 '23 11:01 InbarShirizly

Are there any updates on this issue? We are seeing long build times on our local project.

siephen avatar Oct 23 '23 18:10 siephen