pandas-ai
pandas-ai copied to clipboard
sinaptik-ai
Auto-Insights
🚀 The feature
Based on the table structure -Top n rows -Dataframe Descriptive //Min, Max, Avg, etc. ..
Output: List of possibles prompts
eg. "Plot a PCA with 3 clusters".
Motivation, pitch
As a BI Not even the most expert in the business is used to seeing +10 variables on a table and being able to correlate them intuitively and gets harder when they are from different areas.
As a DS Sometime you get so use to a chart or at certain type of analysys that forget to explore new approaces.
Alternatives
No response
Additional context
No response
Hey guys for this enhacement or aditional functionality we could use pandas profiling https://github.com/ydataai/ydata-profiling. A JSON containing several preliminary insights about the dataset is among the outputs. This can be a useful first step before performing computations with the LLM. @gventuri @aryandgandhi
That's a very nice idea. Haven't tried it out, but seems super interesting and it would also be fast to implement. @Edu126 would you like to try to implement it or you'd rather someone else taking care of it?
(Edit) I'm not that good at python testing yet so is better if you could work on it, here is my source code with an example in how to extract the alerts from the HTML report (Not available in other format)
Chat GPT generates :
-Initial insights based on the alerts + df.head() + df.describe()
-Based on the preoious data some data manipulations recommendations: An initial description for each column
Jupyter notebook Archive.zip