incubator-toree icon indicating copy to clipboard operation
incubator-toree copied to clipboard

[TOREE-492] Add DataFrame displayer

Open manuzhang opened this issue 7 years ago • 6 comments

manuzhang avatar Nov 23 '18 03:11 manuzhang

@lresende could you please take a look ?

manuzhang avatar Dec 04 '18 09:12 manuzhang

  • What's the main difference between this and %dataframe
  • Do we have to do any special handle for dataset ?
  • Could you please add a little user documentation on how to use it (other displayers might be helpful as well).
  • Could you please add a simple test case

lresende avatar Dec 16 '18 02:12 lresende

@lresende

  1. I was not aware of the %dataframe magic. This PR adds a syntactic sugar over df.head(20) where both df and df.head need %truncation off to be displayed in html format. In practice, I do a lot of df.show()s to get sample results which are not pretty printed. Now I know it can be achieved through %dataframe but I wonder it would better to display sampled df in html format by default (without any magic).

  2. Do you know where to add the corresponding test case and doc for ScalaDisplayer ? All I've found are some notebook tutorials.

manuzhang avatar Dec 17 '18 09:12 manuzhang

@manuzhang It would be great if the displayer works by default (the same way as a pandas data frame). Is that working for you ?

mohammedi-haroune avatar Sep 01 '19 09:09 mohammedi-haroune

@mohammedi-haroune yes, that works for me

manuzhang avatar Sep 01 '19 14:09 manuzhang

@manuzhang Thanks for you reactivity. I will check it out.

mohammedi-haroune avatar Sep 01 '19 21:09 mohammedi-haroune