Skip to content

Deactivate SafeGraph Weekly Patterns signals. #932

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 30, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 67 additions & 5 deletions docs/api/covidcast-signals/safegraph-inactive.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,9 +12,9 @@ grand_parent: COVIDcast Epidata API
* **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution)

This data source uses data reported by [SafeGraph](https://www.safegraph.com/)
using anonymized location data from mobile phones. SafeGraph provides several
different datasets to eligible researchers. We surface signals from two such
datasets. This dataset is no longer updated after April 19th, 2021.
using anonymized location data from mobile phones. From June 2022-July 2022,
SafeGraph provided several different datasets to eligible researchers. We
surface signals from two such datasets.

## Table of Contents
{: .no_toc .text-delta}
Expand All @@ -28,10 +28,12 @@ datasets. This dataset is no longer updated after April 19th, 2021.
* **Number of data revisions since June 23, 2020:** 1
* **Date of last change:** November 3, 2020

This dataset is no longer updated after April 19th, 2021.

Data source based on [social distancing
metrics](https://docs.safegraph.com/docs/social-distancing-metrics). SafeGraph
provides this data for individual census block groups, using differential
privacy to protect individual people's data privacy.
provided this data for individual census block groups, using differential
privacy to protect individual people's data privacy.

Delphi creates features of the SafeGraph data at the census block group level,
then aggregates these features to the county and state levels. The aggregated
Expand Down Expand Up @@ -72,3 +74,63 @@ SafeGraph provides this data with a three-day lag, meaning estimates for a
specific day are only available three days later. It may take up to an
additional day for SafeGraph's data to be ingested into the COVIDcast API.

## SafeGraph Weekly Patterns

* **Earliest issue available:** November 30, 2020
* **Number of data revisions since June 23, 2020:** 0
* **Date of last change:** never

This dataset is no longer updated after July 15th, 2022.

Data source based on [Weekly
Patterns](https://docs.safegraph.com/docs/weekly-patterns) dataset. SafeGraph
provided this data for different points of interest
([POIs](https://docs.safegraph.com/v4.0/docs#section-core-places)) considering
individual census block groups, using differential privacy to protect individual
people's data privacy.

Delphi gathers the number of daily visits to POIs of certain types (bars,
restaurants, etc.) from SafeGraph's Weekly Patterns data at the 5-digit ZipCode
level, then aggregates and reports these features to the county, MSA, HRR, and
state levels. The aggregated data is freely available through the COVIDcast API.

For precise definitions of the quantities below, consult the [SafeGraph Weekly
Patterns documentation](https://docs.safegraph.com/docs/weekly-patterns).

| Signal | Description |
| --- | --- |
| `bars_visit_num` | The number of daily visits made by those with SafeGraph's apps to bar-related POIs in a certain region <br/> **Earliest date available:** 01/01/2019 |
| `bars_visit_prop` | The number of daily visits made by those with SafeGraph's apps to bar-related POIs in a certain region, per 100,000 population <br/> **Earliest date available:** 01/01/2019 |
| `restaurants_visit_num` | The number of daily visits made by those with SafeGraph's apps to restaurant-related POIs in a certain region <br/> **Earliest date available:** 01/01/2019 |
| `restaurants_visit_prop` | The number of daily visits made by those with SafeGraph's apps to restaurant-related POIs in a certain region, per 100,000 population <br/> **Earliest date available:** 01/01/2019 |

SafeGraph delivers the number of daily visits to U.S. POIs, the details of which
are described in the [Places
Manual](https://readme.safegraph.com/docs/places-manual#section-placekey)
dataset. Delphi aggregates the number of visits to certain types of places,
such as bars (places with [NAICS code =
722410](https://www.census.gov/cgi-bin/sssd/naics/naicsrch?input=722410&search=2017+NAICS+Search&search=2017))
and restaurants (places with [NAICS code =
722511](https://www.census.gov/cgi-bin/sssd/naics/naicsrch)). For example,
Adagio Teas is coded as a bar because it serves alcohol, while Napkin Burger is
considered to be a full-service restaurant. More information on NAICS codes is
available from the [US Census Bureau: North American Industry Classification
System](https://www.census.gov/eos/www/naics/index.html).

The number of POIs coded as bars is much smaller than the number of POIs coded as restaurants.
SafeGraph's Weekly Patterns data consistently lacks data on bar visits for Alaska, Delaware, Maine, North Dakota, New Hampshire, South Dakota, Vermont, West Virginia, and Wyoming.
For certain dates, bar visits data is also missing for District of Columbia, Idaho and Washington. Restaurant visits data is available for all of the states, as well as the District of Columbia and Puerto Rico.

### Lag

SafeGraph provides newly updated data for the previous week every Wednesday,
meaning estimates for a specific day are only available 3-9 days later. It may
take up to an additional day for SafeGraph's data to be ingested into the
COVIDcast API.

## Limitations

SafeGraph's Social Distancing Metrics and Weekly Patterns are based on mobile devices that are members of SafeGraph panels, which is not necessarily the same thing as measuring the general public. These counts do not represent absolute counts, and only count visits by members of the panel in that region. This can result in several biases:

* **Geographic bias.** If some regions have a greater density of SafeGraph panel members as a percentage of the population than other regions, comparisons of metrics between regions may be biased. Regions with more SafeGraph panel members will appear to have more visits counted, even if the rate of visits in the general population is the same.
* **Demographic bias.** SafeGraph panels may not be representative of the local population as a whole. For example, [some research suggests](https://doi.org/10.1145/3442188.3445881) that "older and non-white voters are less likely to be captured by mobility data", so this data will not accurately reflect behavior in those populations. Since population demographics vary across the United States, this can also contribute to geographic biases.
87 changes: 0 additions & 87 deletions docs/api/covidcast-signals/safegraph.md

This file was deleted.