Nok Lam Chan

Results 535 comments of Nok Lam Chan
trafficstars

@lrcouto See #4097 The original tests are not that useful because they are not testing the actual logger (root) that do the work. I removed the cache as I don't...

Is it possible to push the `lock` to something like` _get_dataset` instead? The reason is `dataset.load()` takes long time and it could block the other thread. The actual thing that...

> I understand the concerns about performance, but it will only affect cases when reading from external sources, as local reads are not parallel with Python threads anyway. Though I...

Sorry for not realising this earlier😅 With the new concern with Spark, my priorities are: 1. Solution 2 - Eagerly resolve pattern before pipeline. 2. Do nothing (because I assume...

@lrcouto Would it be possible to test this since you are working on the pipeline setup? I think this may be a good test case.

Full conversation: https://linen-slack.kedro.org/t/22897367/hey-team-i-am-using-dot-separated-namespacing-in-my-paramete#c1d0c9e0-cc4a-428c-a609-246c9e463702 TL;DR I think the two things mentioned above are separate issues. 1. require change in the internal data structure of the config, 2. is an smaller change,...

Can you explains how did you run into that error? What script/command did you run? ``` DATA_CATALOG_CLASS = DataCatalog DATA_CATALOG_ARGS = CATALOG ``` I am confused as `CATALOG` seems to...

@eduheise-andela I have updated the title, since I don't think this is related to coupling/de-coupling. The question here seems to be that you want to use Python (or at least...

Providing some context for "What is UnityCatalog" as I personally find their docs are very confusing. I think the main differentiation is more enterprise focus on governance/access control. >Unity Catalog...

With that in mind, my questions are: - What are the benefits integrating with UnityCatalog? - Does Kedro users need to interact with UnityCatalog? Databricks users today can already use...