Nok Lam Chan

Results 547 comments of Nok Lam Chan
trafficstars

We should really treat Kedro as a Pipeline DSL. Most of the orchestrator work as a DAG, so these are all generic feature. For example: - Grouped memory nodes in...

Wow, just discover this thread after I started this thread in [GitHub Discussion](https://github.com/quantumblacklabs/kedro/discussions/795). This issue is a much more in-depth one and I agree with most of it. I have...

Cannot find the related issue so i just post it here From the pandera author about the env variable to disable runtime check. hi so a validation on/off switch was...

Indeed, I actually made the PR 😁 https://github.com/unionai-oss/pandera/pull/1354

> 1. In addition to runtime validation through annotated python > 2. So I’d be interested in exploring if we could use the new catalog metadata to declare this on...

In case user pass a `string` as value instead of a dataset, they will just get a `ValueError` because the dataset does not exist. It would be nice to provide...

Closing in favor of https://github.com/kedro-org/kedro/pull/3715. I think the initial idea was mainly about the `str` problem though it's more generic than that.

In other words, if we consider `kedro new` or `kedro pipeline create` not a "core" functionalities, we can move it out from the core dependencies. The tricky bit here is...

For the records, there are proposal for optional `opt-out` dependencies (from the Pydantic's author): https://discuss.python.org/t/optional-dependency-groups-omitting-package-requirements/20833 This problem is also not unique to us, see this quote from the FastAPI's author...

This is my proposed solution: ### 1. Move `cookiecutter` out from core and to something like `kedro[new]` /`kedro[init]` When user run `kedro new`: If they have `cookiecutter` installed, it should...