Generated population doesn't match input controls

[replicahq]

Generated population doesn't match input controls

[alexeisw]

Sounds good. Re your question why would one use household weights other than the seed, PUMS is a solid data source by itself, and in most applications it would be enough to just use the household expansion weights it provides to have a reasonable estimate of a population statistic that match the totals at PUMA level.

BTW, if you really need to run synthesis for tracts within a lower/higher level of allocation geography that does not match PUMA, you could possibly subsample the table, or scale household weights in the table proportionally to the expected totals for that area.

[gregmacfarlane]

ccing my colleague @josiekre

[alexeisw]

Hi Greg, Hi Josie,

the data you are feeding into the algorithm is inconsistent, in a sense that household weights do not sum (not even approximately) to the same values as the marginals data for the total number of households. It results in the doppelganger allocation algorithm to return a population with the total number of households that sums to a value in between the two. When you decreased the total sum in controls, it has returned a population with a lower sum too, accordingly.

One option is to fix the input data to make sure weights match the marginals (can be approx). Other option is to tune the internal parameter https://github.com/sidewalklabs/doppelganger/blob/master/doppelganger/allocation.py#L170
to make it converge to either initial PUMS weights or the marginals. Hope this helps,

Alexei

[gregmacfarlane]

Interesting; so, if I understand correctly doppelganger considers both the PUMA weighted population in PUMS and the ACS tract-level population. It seems as though there will be times when we want to synthesize a population for only part of a PUMA, meaning that the controls should (for lack of a better word) control. Or, if we are looking at an alternative population scenario, changing both the weights and the controls is duplicative.

---

I just cranked up the gamma parameter you identified (I will send you a PR exposing that parameter), but it of course has the consequence of substantially increasing the run time. Is there a specific reason why I would want to respect or consider the PUMA weights in this process, other than as a seed?