Nok Lam Chan

Results 596 comments of Nok Lam Chan

I cannot reproduce the issue following the description, I can produce the same error with following: ```python def test_data_science_pipeline(caplog, dummy_data, dummy_parameters): pipeline = ( create_ds_pipeline() .from_nodes("split_data_node") .to_nodes("train_model_node") ) catalog =...

@MinuraPunchihewa Do you have an idea? I am actually confused that `ManagedTableDataset` is an `AbstractVersionedDataset`, which has `resolve_load_version()` etc. This is designed for file-based data, not for Table. The table...

I'd be looking at some PoC to play with Iceberg and versioning and may come back to this a little bit. @jstammers The other options is do this validation with...

> About you comment on AbstractVersionedDataset being used for file-based data. Is that how it is meant to be used? I was under the impression that it can be used...

This seems contradicts to the conclusion of https://github.com/kedro-org/kedro-plugins/issues/25?

The tests are now triggered as a Github Action job: - [pipeline-performance-test.yml](https://github.com/kedro-org/kedro/blob/main/.github/workflows/pipeline-performance-test.yml) - [benchmark-performance.yml](https://github.com/kedro-org/kedro/blob/main/.github/workflows/benchmark-performance.yml) Wiki: https://github.com/kedro-org/kedro/wiki/The-Performance-Testing-Setup

@janickspirig Are you interested to open a PR? If so, go ahead!

I realised I didn't leave a comment here. I created this last year https://github.com/noklam/kedro-viz-lite. I actually don't remember if I succeed at the end, the logic are mostly in https://github.com/noklam/kedro-viz-lite/blob/main/kedro_viz_lite/core.py....

I've seen Openlineage in a few issues, but is it related to this? From what I understand it's more about understanding the lineage between systems, how data flows from different...

> "Is there a way to get the project details like (pipelines, nodes etc) without actually creating a kedro session ?" paging @noklam @astrojuanlu https://github.com/noklam/kedro-viz-lite, glad you asked. I'd love...