ElenaKhaustova

[DataCatalog]: Iterate through datasets objects in the catalog

1

## Description Implement iterable support for the `catalog.datasets`, allowing users to iterate through datasets objects directly. We propose to implement iterable support for the `catalog.datasets`, allowing users to iterate through...

[DataCatalog]: Catalog serialization and deserialization support

2

## Description 1. Users admit the lack of persistency in the add workflow, as there is no built-in functionality to save modified catalogs. 2. Users express the need for an...

[DataCatalog]: Provide public methods to modify catalog

1

## Description Plugin developers and advanced users face limitations due to the absence of public methods for modifying the catalog datasets, and injecting dynamic behaviour or configuration parameters on the...

## Description Users encounter challenges related to accessing and managing dataset filepaths. The absence of a mandatory filepath attribute in `AbstractDataset` and the lack of a standard API for accessing...

## Description Users face challenges with understanding and effectively utilizing the `_FrozenDatasets` public API due to unclear documentation and limitations. They struggle to get dataset by name, iterate through datasets...

## Description - The current design complicates dataset pattern resolution, leading to confusion. - Resolution logic residing in the private `_get_dataset()` method forces people to stick to private API since...

Query endpoint for `SnowparkTableDataset`

3

## Description `SnowparkTableDataset` dataset configuration does not have a query endpoint, so running database-level SQL queries is not possible at the catalog level. Thus users have to make it at...

Fixe using `ThreadRunner` with dataset factories

23

## Description Fixes https://github.com/kedro-org/kedro/issues/4007 The issue is not deterministic and appears depending on the order in which threads are executed. The issue appears for `ThreadRunner` when loading the same pattern...

## Description The PR is done on top of https://github.com/kedro-org/kedro/pull/4071 Update logic to run Kedro project with `KedroDataCatalog`. Works with `SequentialRunner`, `ThreadRunner` and `ParallelRunner`. ## Development notes To run the...

## Description Update of CLI logic on top of https://github.com/kedro-org/kedro/pull/4070 Solves https://github.com/kedro-org/kedro/issues/3925, https://github.com/kedro-org/kedro/issues/3926, https://github.com/kedro-org/kedro/issues/3916 ## Development notes This PR includes refactoring CLI logic and using `KedroDataCatalog` implementation from https://github.com/kedro-org/kedro/pull/4070. All...