Nok Lam Chan

Results 588 comments of Nok Lam Chan

I cannot reproduce my error before exactly. I remember manually downgraded requests & cachetools & pyspark before. If I upgraded my requests library I will get this. ``` raise VersionConflict(dist,...

Anyway, I solved the issue by looking at the `VersionConflict` and downgrade all those library manually.

It needs to handle both cases: 1. IPython - It is not using `sys.excepthook` and I haven't figured out how to restore it. 2. Non IPython - this seems to...

Adding examples: * https://github.com/kedro-org/kedro/issues/2169#issuecomment-1447778966

Closing this in favor of https://github.com/kedro-org/kedro-plugins/issues/117, https://github.com/kedro-org/kedro/issues/2323 and https://github.com/kedro-org/kedro-plugins/pull/114 I am quite confident this should work now, we've added warning and improve the documentation for using it correctly with Databricks....

@astrojuanlu The important thing here is "Packaged project" and "Kedro Project" In a simplified world, , `python -m ` or the `main` function is basically `bootstrap_project` + `KedroSession.run`. There are...

> Thanks, that's helpful. So this issue concerns the Databricks workflows that use packaged projects only, hence "Databricks jobs" at the moment. Please correct me if I'm wrong. It is...

Leave a comment here: https://github.com/kedro-org/kedro/issues/3237#issuecomment-1969278134. This goes beyond Databricks so I want to keep the conversation on the broader topic.

This https://github.com/kedro-org/kedro/pull/1614 could potentially solve the problem. In the past Kedro always import the multi-processing module.

Potentially useful IPython magic * `get_ipython().set_next_input(s)` * `%debug` * `%load` * `from inspect import getsource`