Backend cleanup

[emma-nechamkin]

GOAL: we should do this week of 9/19!

We have lots of "clean up" to do on the back end. Some of this "clean up" will impact the front end. This is lower priority than testing and ground truthing, but is necessary (in my opinion) before 1.0 launches.

Clean up tasks

• [x] all variables that get ported over to the tiles must have an N instead of an M
• [x] SM_PFS should be removed
• [ ] Threshold count and category count must be updated (details below) or removed
• [ ] Delete all variables not used in Score Narwhal (can we also delete M?) -- we can always look back at our github history.
• [ ] Vim has a spreadsheet that identifies all BE signals and possible a ton we can remove
• [ ] there's a bunch of variables that we construct in ETL score and score post that we do not need to include (same with data sources). We should remove so we don't have to provide support, etc

Threshold / category count For each data source, include in the denominator only data sources that are not null within that tract.

As I continue to find these issues, I'll post them here :)

[emma-nechamkin]

I've assigned this to everyone for visibility...

[vim-usds]

@emma-nechamkin - is it possible to check if this ticket is still needed? Matt removed some BE signals and wondering if his work satisfies the tasks on this ticket? (if you happen to know)

[KameronKerger]

also related to the columns.csv and the codebook issue

[KameronKerger]

for clarity, I think there should be one doc called codebook and that the information that is currently in the columns.csv file (the short names) should be added to the codebook.