Every survey estimate is a range

The American Community Survey interviews a sample of households, not every household. Each estimate therefore comes with a margin of error. At the 90% confidence level used by the Census Bureau, intervals built as the estimate plus or minus its margin would contain the true value in about 90% of repeated samples. A margin of ±0.2 percentage points means the data are consistent with a true value a little above or below the published figure.

The test behind “higher” and “lower”

Two estimates are treated as different when the gap between them is larger than the square root of the sum of their squared margins of error. Washington’s rate is 93.6% ±0.1 percentage points and Colorado’s is 93.5% ±0.2 percentage points. The gap between them is not statistically significant at the 90% confidence level. By contrast, Washington and Mississippi (84.1%) differ by far more than their combined margins, so that difference is clearly statistically significant at the 90% confidence level.

Overlapping intervals are not the test

A common shortcut is to check whether two intervals overlap. It is too strict: two intervals can overlap a little while the difference between the estimates is still statistically significant, because the margin of a difference is smaller than the sum of the two margins. The test above uses the correct combined margin. When a profile on this site says one place is “higher,” that statement has passed it.