Skip to content

Commit 9abe0ef

Browse files
authored
Merge pull request #908 from cmu-delphi/ndefries/alert-unweighted-ses
[CTIS] Add note that current SEs are unweighted
2 parents 54fe1d6 + 19199e8 commit 9abe0ef

File tree

2 files changed

+9
-2
lines changed

2 files changed

+9
-2
lines changed

docs/api/covidcast-signals/fb-survey.md

+8-1
Original file line numberDiff line numberDiff line change
@@ -726,6 +726,13 @@ of zero, and in simulations improves the quality of the standard error
726726
estimates. See the [Appendix](#appendix) for further motivation for these
727727
estimators.
728728

729+
<div style="background-color:#FCC; padding: 10px 30px;"><strong>Note:</strong>
730+
Currently the standard errors are calculated as though all survey weights are
731+
equal, that is \(w^\text{part}_i = 1\) for all respondents. The result is that
732+
reported standard errors are artificially narrow for weighted estimates. This
733+
will be corrected in a future update to the API.
734+
</div>
735+
729736
The pseudo-observation is not used in $$\hat{p}$$ and $$\hat{q}$$ themselves, to
730737
avoid potentially large amounts of estimation bias, as $$p$$ and $$q$$ are
731738
expected to be small.
@@ -750,7 +757,7 @@ knowing someone in their community who is sick. In this subsection we will
750757
describe how survey weights are used to construct weighted estimates for these
751758
indicators, using community CLI as an example.
752759

753-
In a given aggregation unit (for example, daily-county), let $$U_i$$ the
760+
In a given aggregation unit (for example, daily-county), let $$U_i$$ denote the
754761
indicator that the survey respondent knows someone in their community with CLI,
755762
including their household, for survey $$i$$, out of $$m$$ surveys collected.
756763
Also let $$w_i$$ be the weight that accompanies survey $$i$$, normalized to sum

docs/symptom-survey/contingency-tables.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -173,7 +173,7 @@ for download, and specifies the survey questions on which they are based. See
173173
the <a href="coding.html">survey instrument codebook</a> for the full text of
174174
all questions.</div>
175175

176-
The files contain [weighted estimates](../api/covidcast-signals/fb-survey.md#survey-weighting)
176+
The files contain [weighted estimates](../api/covidcast-signals/fb-survey.md#survey-weighting-and-estimation)
177177
of the percent of respondents who fulfill one or several criteria. Estimates are
178178
broken out by state, age, gender, race, ethnicity, occupation, and health
179179
conditions.

0 commit comments

Comments
 (0)