Booklet-DataFrame icon indicating copy to clipboard operation
Booklet-DataFrame copied to clipboard

Include examples of a full ETL pipeline

Open trosel opened this issue 6 years ago • 1 comments

This may be outside the scope of the booklet, but there is a lack of information on how to obtain data from APIs and then format that JSON data into dataframes, and then send that off somewhere.

For example, most APIs for getting data would require some kind of oauth1 or oauth2 passed in the client.

And these APIs would most certainly give you JSON which you would need to serialize into Objects or straight into the Dataframe object.

Because in order to visualize data, we need to get it first :)

And then what do you do with the dataframe or visualization afterwards? Do you export the dataframe into a CSV and email that? Do you convert the visualization into a PDF and email that?

trosel avatar Jul 16 '18 14:07 trosel