Joel

Results 348 comments of Joel

I'll also highlight the great work dbt do with adding documentation and tests to their source and models: https://docs.getdbt.com/docs/building-a-dbt-project/using-sources#testing-and-documenting-sources

So my next question is - then what? The user as provided some arbitrary metadata: - Is it only available via hooks or the code API at runtime? - Do...

My view is that LSP is the right solution for all of this :)

Can I ask that we include the example how to save a multi-sheet as well? The instructions to do so are buried in in the DataSet docstring: https://github.com/kedro-org/kedro/blob/59064403e2590c992dceb51942f7dd9f6c97898a/kedro/extras/datasets/pandas/excel_dataset.py#L104

Discord user experiencing [similar issue](https://discord.com/channels/778216384475693066/778998585454755870/958443528931909682)

I've been thinking it may be nice to have some sort of `AbstractExecutionContext` that we could use for Spark, Dask, Snowpark and others ...

I think you have to assume you would want local/dev/prod spark configuration environments. I think all of these can be migrated to this pattern, my push here is to make...