data-making-guidelines
data-making-guidelines copied to clipboard
datamade
:blue_book: Making Data, the DataMade Way
our prior recommendation, removed in 4bb8d76177c40c9a0405ca66da9a40dcbded4505, caused issues with makefiles on ubuntu 16.x (xenial), i.e., on our staging server, such that all recipes failed with the error "No such file...
The example doesn't work with GNU Make 3.81 on MacOS, so I collapsed that example out.
We've got great documentation for generating files, but we could use more detail about a concise and Make-ish approach for building databases, e.g., writing SQL-heavy Makefiles. A really great example...
writing a makefile is really hard if you don't know bash. so is knowing when to write custom processors. writing custom processors is hard if you aren't familiar with our...
We should add this, and possibly other makefiles by outside groups to our list of examples repo: https://github.com/nprapps/allsongsconsidered-poll/ blog post: http://blog.apps.npr.org/2018/01/03/all-songs-considered-poll.html
i'm not sure if it's just me, but it seems like we typically use a file structure more [like this](https://github.com/datamade/data-making-guidelines/blob/master/styleguide.md#5-etl-workflow-directory-structure) than [the one we suggest in this repo](https://github.com/datamade/data-making-guidelines/blob/master/styleguide.md#5-etl-workflow-directory-structure). is this...
These guidelines need more interactive, full-immersion fun. Let's create a didactic tutorial for a rounder learning experience.
Regina and Jack will walk through these guidelines and provide feedback.
This is something that I struggled with when I first started using make to work with data on the [edifice](https://github.com/chihacknight/edifice) project. I picked up these conventions from a DataMade project...
Was wondering if you have been able to integrate make into workflows that require working with remote services/servers? I've generally had to turn to Drake or Luigi in these use...
