ibis-examples icon indicating copy to clipboard operation
ibis-examples copied to clipboard

Add Hanukkah of Data 5783 example

Open jcrist opened this issue 1 year ago • 1 comments

Several members of the Ibis team did Hanukkah of Data (HoD) this past year using Ibis. It would be nice to have a notebook in this repo solving all the problems as examples.

My solutions are here if we want to use them, but there are lots of ways to solve these problems.

I reached out to Saul (one of the HoD creators), and he said they'd continue to host the data at the current address, so we should be able to download the data from there as part of the notebook, rather than hosting the data ourselves.

If I were writing this example notebook, I'd write it as:

  • A bit of leading prose describing HoD
  • Downloading and setting up the data
  • A brief exploration of the tables
  • Then iterating through the problems:
    • Problem question copy-pasted into notebook
    • Possibly a bit of prose breaking down the question into its components to lead the reader to the right query to ask. Might also point the user at a few ibis methods we think they might want to use (linking to the proper API docs).
    • Blank cell for user to solve the problem themselves
    • Cell loading solution from a separate solution_{number}.py file (using the %load magic). This will still run as part of our tests, but keeping the solution out of the original notebook would let the reader try it themselves first

I think the HoD questions are really well done, and writing the queries required touch a lot of common points of Ibis. Having a notebook environment setup to try to solve these problems may be a great way for users to practice using ibis.

jcrist avatar Mar 01 '23 18:03 jcrist

Picking this up!

anjakefala avatar May 01 '23 16:05 anjakefala