Nok Lam Chan
Nok Lam Chan
I cannot reproduce my error before exactly. I remember manually downgraded requests & cachetools & pyspark before. If I upgraded my requests library I will get this. ``` raise VersionConflict(dist,...
Anyway, I solved the issue by looking at the `VersionConflict` and downgrade all those library manually.
It needs to handle both cases: 1. IPython - It is not using `sys.excepthook` and I haven't figured out how to restore it. 2. Non IPython - this seems to...
Adding examples: * https://github.com/kedro-org/kedro/issues/2169#issuecomment-1447778966
Closing this in favor of https://github.com/kedro-org/kedro-plugins/issues/117, https://github.com/kedro-org/kedro/issues/2323 and https://github.com/kedro-org/kedro-plugins/pull/114 I am quite confident this should work now, we've added warning and improve the documentation for using it correctly with Databricks....
@astrojuanlu The important thing here is "Packaged project" and "Kedro Project" In a simplified world, , `python -m ` or the `main` function is basically `bootstrap_project` + `KedroSession.run`. There are...
> Thanks, that's helpful. So this issue concerns the Databricks workflows that use packaged projects only, hence "Databricks jobs" at the moment. Please correct me if I'm wrong. It is...
Leave a comment here: https://github.com/kedro-org/kedro/issues/3237#issuecomment-1969278134. This goes beyond Databricks so I want to keep the conversation on the broader topic.
This https://github.com/kedro-org/kedro/pull/1614 could potentially solve the problem. In the past Kedro always import the multi-processing module.
Potentially useful IPython magic * `get_ipython().set_next_input(s)` * `%debug` * `%load` * `from inspect import getsource`