flowsa icon indicating copy to clipboard operation
flowsa copied to clipboard

Estimate non-zero FlowAmounts when below source reporting threshold

Open matthewlchambers opened this issue 3 years ago • 4 comments

The Aircraft row is missing from a newly generated EPA_GHGI_T_3_14 FBA (year is 2016, if that matters).

matthewlchambers avatar Dec 06 '22 17:12 matthewlchambers

Yes there are a few lingering issues in a handful of tables that i'm working through. Feel free to document any more that you see here.

bl-young avatar Dec 06 '22 17:12 bl-young

I see that for 2016, that row is identified as being less than 0.05 MMT (specific value not given). Is that why it's excluded? If so, maybe there's a better way of handling that situation?

matthewlchambers avatar Dec 06 '22 18:12 matthewlchambers

I see that for 2016, that row is identified as being less than 0.05 MMT (specific value not given). Is that why it's excluded? If so, maybe there's a better way of handling that situation?

Yep that would be it. I do think your update to add a new field for that makes sense. In the current GHGI branch its not yet implemented.

bl-young avatar Dec 06 '22 19:12 bl-young

Renamed this issue to broaden the scope to the issue at heart of this example.. when a source provided no value but it is also not given as zero, such as a '+' or '-' symbol. This could be, for example, when it's less than the significant figures provided.

WesIngwersen avatar Feb 09 '23 14:02 WesIngwersen

This is really something that needs to be implemented for each specific FBA. We have a few examples now where this is done:

EIA MECS: https://github.com/USEPA/flowsa/blob/0d44ae9de372640d63926eb26208cbb31ec3665d/flowsa/data_source_scripts/EIA_MECS.py#L426-L432

Census SAS: https://github.com/USEPA/flowsa/blob/c18da34e36856ffb8aeebbbbc9ea07dee53e04fa/flowsa/data_source_scripts/Census_SAS.py#L66-L82

GHGI: https://github.com/USEPA/flowsa/blob/56c6da4e03e0629c91b1e76a6ee727950e29fce3/flowsa/data_source_scripts/EPA_GHGI.py#L441-L460

The approach to handling of the suppressed data is then indicated in a FBS, for example this function for MECS: https://github.com/USEPA/flowsa/blob/0d44ae9de372640d63926eb26208cbb31ec3665d/flowsa/data_source_scripts/EIA_MECS.py#L437-L458

bl-young avatar May 24 '24 13:05 bl-young

Going to close this issue as resolved knowing that this can be added to FBAs as they are updated.

bl-young avatar May 24 '24 13:05 bl-young