open-grid-emissions icon indicating copy to clipboard operation
open-grid-emissions copied to clipboard

Improve quality of --small test run

Open gailin-p opened this issue 2 years ago • 1 comments

Improvements to make --small test run option more useful

--small is meant to be a quick way to exercise the entire data generation pipeline and validation checks, so during development we can be confident that we're not breaking anything. Some improvements would make it easier to run:

  • [ ] Small should be run as a pre-commit hook so that the pipeline always works
  • [ ] With the --small option, the partial_cems dataframe has no entries. We want to make sure the --small run has some partial cems data, so that parts of the code dealing with scaling and handling partial cems data are exercised by --small. (issue identified in #162 )

gailin-p avatar Aug 03 '22 18:08 gailin-p

small also is currently missing any plants that use the cems_profile method for hourly profile creation.

gailin-p avatar Aug 22 '22 19:08 gailin-p