populationsim icon indicating copy to clipboard operation
populationsim copied to clipboard

create inputs pre-processor

Open bstabler opened this issue 8 years ago • 2 comments

The inputs pre-processor reads each input table, runs pandas expressions (*_expressions.csv) against the table to create additional required table fields, and save the tables to the datastore. For example, it processes raw Census tables to create the required fields for population synthesis. The inputs pre-processor exposes all input tables to the expressions calculator so tables can be joined (such as households to persons for example). It reads the geographic crosswalk file in order to join meta, mid, and low level zone tables if needed. The format of the expressions file follows ActivitySim, as shown in the example below. The seed_households expressions file below operates on the seed_households input file and processes the NPF field to create the FAMTAG field, which is then used by PopulationSim in later steps.

Description Target Expression
HH is a family FAMTAG pd.notnull( NPF ) * 1

bstabler avatar Nov 07 '17 00:11 bstabler

@danielsclint suggested PopulationSim should be able to download the census bureau data directly as well.

bstabler avatar Nov 07 '17 00:11 bstabler

Check this out as well - https://github.com/psrc/census_getter - and let's add a link to the PopulationSim documentation.

bstabler avatar Jun 14 '19 22:06 bstabler