geekan
DataInterpreter - Could the saving of tabular data(dynamically generated) and plots be improved?
Feature description
Proposed feature: The true value of DataInterpreter will be exploited when all data analysis is presented as a report. A lot of tabular data gets generated, during the course of plan execution. There is a lot of slice and dice of data happening, plots generated, etc, during a full run of the DI. I manage to get history using save_history(), but the intermediate tabular results and plots generated are not clearly saved in the plan.json or code.ipynb.
Could every intermediate table be saved clearly and links to plots generated be saved in the plan.json, for future use? For tables, just add it as part of the plan.json inside each "results" node and for the plots - have an option to say "save_plots_dir" - the path where the plots would get saved, and all plots would get dumped inside that path - then these paths are saved in plan.json, in the correct sequence.
Your Feature
