Lars Albertsson

Results 17 comments of Lars Albertsson

This could likely improve many of our jobs. Thanks! I have considered implementing something similar, but in the storage interface layer, e.g. a GCSClient that batches lookups, potentially backed by...

Yes, I agree it looks useful even in the presence of other caching. Could it make the bulk complete code in the Range classes `missing_datetimes` obsolete? I think that code...

This is a community driven open source project. Hence, there are no plans and no roadmap. If you care about updated azure integration, you can drive the issue forward by...

@freider We have use cases where I feel that a shared target state cache or something similar would make a significant difference. We often have large dependency trees where most...

Luigi will per default not wait for pending requirements to complete. You can change this with the configuration setting worker.keep_alive. It is good practice to ensure that a task is...

The scheduler behaves as you expect, if you set the keep_alive option. The trap that I am trying to highlight is that you cannot be sure which job will run...

I am not a maintainer, but I think it would be great to get this in. We also use parallel scheduling to cut down latency until first task execution.

With the usual disclaimer that I am not a maintainer, I am familiar with the code and would like this PR to get in, so I'll contribute a review. It...

The error indicates that you have previously created a class with the same name. I think that under some circumstances, that might be ok, but you cannot then instantiate those...

@bbreton This is a community-driven project, without a backing open source based business. You can offer to help by improving the PR, creating a better solution, or offer to fund...