gokart

gokart copied to clipboard

When a task is running and logging to the console, those log outputs should be captured and stored in the pickled task_log files. This would allow you to see the...

TaylerUva

RuntimeError: Unfulfilled dependency at run time

1

Luigi (also gokart) implicitly assumes that the file is output when the Task `run` is executed, and if it is not, an error `Unfulfilled dependency at run time` is raised...

e-mon

We need a linter for sphinx. https://github.com/maet3608/splint

vaaaaanquish

For daily operations on public cloud environment, gokart should support structured logging. It enables us efficient searching, easy monitoring and alert configuration on logs. On the other hand, structured logging...

hirosassa

Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 4.21.4 to 4.21.6. Release notes Sourced from protobuf's releases. Protocol Buffers v3.0.0-beta-4 Version 3.0.0-beta-4 General Added a deterministic serialization API for C++. The deterministic serialization guarantees that...

dependabot[bot]

SSIA

hirosassa

# Introducing Task Run Locking for Enhanced Concurrency Control in Gokart ## tl;dr - Introduces task run locking in Gokart for better concurrency control. - Prevents redundant task executions in...

mski-iksm

Use `dill` instead of `pickle` for processing `.pkl` files

2

Introduce [`dill`](https://dill.readthedocs.io/en/latest/) library as a serializer instead of `pickle` for all `.pkl` files. gokart has its own file processors for various file formats. For `.pkl` files, we have used standard...

maronuu

extra gcs and s3

3

### Problem * now we always have to install both s3 and gcs dependencies * it causes * more lock problem, since python's dependency resolving(like Poetry) is fragile * unnecessary...

yokomotod

Hi-king