Support upload of raceeth microdata in Makefile

[nmdefries]

Description

Put #1183 into production.

Changelog

• Add make target to upload race-eth microdata files to protected-race-ethnicity-data/ dir. Runs as part of pipeline target.
• Add raceeth microdata dir to clean and tidy targets.
• Add individual_raceeth_dir and produce_individual_raceeth default settings to the template production params file.
• Turn on produce_individual_raceeth in the params make target.

[krivard]

Would you add the new keys to params.json.template and params.json.production.template please?

[krivard]

👍

[krivard]

Should I wait for Alex on this or go ahead and merge once it finishes building?

[capnrefsmmat]

I approve provided @krivard has looked at the Make and agrees that the raceeth files will end up in SFTP under protected-race-ethnicity-data/, and won't accidentally end up elsewhere

[capnrefsmmat]

Also note that whatever script runs monthly-files.R should also run it on the raceeth data each month, to produce monthly race/ethnicity rollups.

[nmdefries]

I haven't seen any scripts or make targets that do the monthly rollup. @krivard is that committed to the repo somewhere?

[krivard]

Here's the monthly rollup builder:
https://github.com/cmu-delphi/covidcast-indicators/blob/main/facebook/monthly-files.R

It's called by a local script that we probably should check into the repo. Recommend addressing posting monthly rollups of raceeth data in a separate PR.

[krivard]

All Makefile changes are legit and won't put raceeth data anywhere except on purpose.

[krivard]

Waiting until Monday to merge this just in case we need to do an emergency deploy of main this afternoon