kue icon indicating copy to clipboard operation
kue copied to clipboard

Jobs with large state take a long time to show in UI

Open nyurik opened this issue 8 years ago • 4 comments

If a job has a very large array (a few MBs) of some internal state, that whole value is downloaded to the browser in the UI. I think that some values, e.g. ones that begin with '_', should not be downloaded, allowing much more efficient job management.

nyurik avatar May 18 '16 21:05 nyurik

I think we should lazy load job.data & job.results

behrad avatar May 19 '16 06:05 behrad

I suspect there is a bit more to it - even though the queue is created with jobEvents=false, when I view the jobs via UI, I suspect that it re-subscribes to all the job, or keeps re-downloading them on each refresh, thus causing out of memory problems.

nyurik avatar Jun 18 '16 15:06 nyurik

+1

alanclarke avatar Sep 19 '16 09:09 alanclarke

+1

guillermodoghel avatar May 15 '18 03:05 guillermodoghel