Skip to content
This repository was archived by the owner on Jun 18, 2024. It is now read-only.

Commit 6bf218d

Browse files
committed
Adding initial guidance for redactions
1 parent fa61d2d commit 6bf218d

File tree

2 files changed

+113
-0
lines changed

2 files changed

+113
-0
lines changed

Diff for: catalog.md

+8
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,14 @@ Inclusion of the Public Data Listing as a Record
6161

6262
Each 'data.json' catalog file should include a record for the data asset that is the data catalog itself. Contact Name and Contact Email can be used to provide a PoC for the 'data.json' efforts; Data Standard (_conformsTo_) can be used to clarify which version of the Project Open Data metadata schema the agency is currently using; and Last Update can be used to indicate the date when the Public Data Listing was last modified.
6363

64+
65+
Including Non-Public Data and Redactions
66+
----------------------------------------
67+
68+
While the Public Data Listing is primarily intended to list datasets thare are (or will be) available for public download, it can also serve as a way to publish information about non-public datasets and to provide information about accessing "restricted public" datasets. Data.gov provides a label to distinguish the `accessLevel` of datasets so that the public is aware that non-public dataset listings are only intended to provide metadata rather than access to the data itself. Metadata listings of non-public datasets on agency websites should also make this distinction clear.
69+
70+
If an agency's FOIA office determines that any metadata provided for these non-public datasets needs to be redacted in order to be displayed publicly, agencies should consult the [Redaction Guidance](/redactions) page for more information.
71+
6472
Presentation
6573
------------
6674

Diff for: redactions.md

+105
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,105 @@
1+
---
2+
layout: default
3+
title: Redaction Guidance
4+
permalink: /redactions/
5+
filename: redactions.md
6+
---
7+
8+
The full Enterprise Data Inventories managed by each agency and submitted to OMB should not contain any redactions. However, if an agency were to make as much of their EDI available within their Public Data Listing as possible, they may need to redact some information based on guidance from their FOIA office. This page is intended to provide direction on how redactions should be implemented in the Public Data Listing JSON file, but guidance on exactly what information needs to be redacted should come from the FOIA office at each agency. However, it is helpful to keep in mind that redactions should be kept to the absolute minimum and according to the [2009 Department of Justice FOIA memorandum](http://www.justice.gov/sites/default/files/ag/legacy/2009/06/24/foia-memo-march2009.pdf), "in the face of doubt, openness prevails." When redactions are implemented, this also means that if only one word in a sentence needs to be redacted, then only that word should be redacted, not the entire sentence, and not the whole field in the JSON file.
9+
10+
## FOIA Exemption Reasons
11+
12+
In order to identify the FOIA exemption used for the redaction, the redaction should use the following syntax to reference the exemption type:
13+
14+
{: .table .table-striped}
15+
Redaction text | Brief FOIA exemption description
16+
------- | -------
17+
[[REDACTED-EX B3]] | Specifically exempted from disclosure by statute (other than FOIA), provided that such statute (A) requires that the matters be withheld from the public in such a manner as to leave no discretion on the issue, or (B) establishes particular criteria for withholding or refers to particular types of matters to be withheld.
18+
[[REDACTED-EX B4]] | Trade secrets and commercial or financial information obtained from a person and privileged or confidential.
19+
[[REDACTED-EX B5]] | Inter-agency or intra-agency memorandums or letters which would not be available by law to a party other than an agency in litigation with the agency.
20+
[[REDACTED-EX B6]] | Personnel and medical files and similar files the disclosure of which would constitute a clearly unwarranted invasion of personal privacy.
21+
22+
23+
## Use the "rights" Field for More Information
24+
Agencies are required to use the `rights` field to provide the reasoning for an `accessLevel` of “non-public” or “restricted public.” If any information has been redacted, it's helpful to also provide the full text description from the FOIA Exemption Reasons table here to complement the explanation for the non-public `accessLevel`.
25+
26+
27+
## Redaction JSON Syntax Example
28+
29+
Redactions should use the syntax provided in the exemption reasons table and they should always be presented as a string even if they are redacting a field that is not normally a string. The JSON Schema validation has been updated to accept redactions like this for fields that would otherwise not allow free text.
30+
31+
~~~json
32+
{
33+
"@context": "https://project-open-data.cio.gov/v1.1/schema/catalog.jsonld",
34+
"@id": "http://www.agency.gov/data.json",
35+
"@type": "dcat:Catalog",
36+
"conformsTo": "https://project-open-data.cio.gov/v1.1/schema",
37+
"describedBy": "https://project-open-data.cio.gov/v1.1/schema/catalog.json",
38+
"dataset": [
39+
{
40+
"@type": "dcat:Dataset",
41+
"accessLevel": "non-public",
42+
"accrualPeriodicity": "R/P1Y",
43+
"bureauCode": [
44+
"018:10"
45+
],
46+
"conformsTo": "http://www.agency.gov/widget-taxonomy/",
47+
"contactPoint": {
48+
"@type": "vcard:Contact",
49+
"fn": "Jane Doe",
50+
"hasEmail": "mailto:[email protected]"
51+
},
52+
"describedBy": "http://www.agency.gov/datasets/widgets-dictionary.html",
53+
"dataQuality": true,
54+
"description": "This dataset provides national statistics on the production of widgets for [[REDACTED-EX B4]]",
55+
"distribution": [
56+
{
57+
"@type": "dcat:Distribution",
58+
"description": "[[REDACTED-EX B4]] widgets data as a CSV file",
59+
"downloadURL": "[[REDACTED-EX B4]]",
60+
"format": "CSV",
61+
"mediaType": "text/csv",
62+
"title": "[[REDACTED-EX B4]]-widgets.csv"
63+
}
64+
],
65+
"identifier": "https://metadata.agency.gov/10.7927/H4PZ56R2",
66+
"issued": "2011-11-22",
67+
"keyword": [
68+
"widget",
69+
"manufacturing",
70+
"factory"
71+
],
72+
"landingPage": "http://agency.gov/widgets/data",
73+
"language": [
74+
"en-US"
75+
],
76+
"license": null,
77+
"modified": "2011-11-19T12:00:00Z",
78+
"primaryITInvestmentUII": "021-006227212",
79+
"programCode": [
80+
"018:001"
81+
],
82+
"publisher": {
83+
"@type": "org:Organization",
84+
"name": "Widget Services",
85+
"subOrganizationOf": {
86+
"@type": "org:Organization",
87+
"name": "Office of Widget Statistics"
88+
}
89+
},
90+
"references": [
91+
"https://agency.gov/docs/widgets-1.html",
92+
"https://agency.gov/docs/widgets-2.html"
93+
],
94+
"rights": "This dataset cannot be made public because it includes trade secrets and commercial or financial information obtained from a person and is privileged or confidential.",
95+
"spatial": "United States",
96+
"systemOfRecords": "http://www.agency.gov/widgets/sorn/",
97+
"temporal": "2009-09-01T12:00:00Z/2010-05-31T12:00:00Z",
98+
"theme": [
99+
"manufacturing"
100+
],
101+
"title": "U.S. Widget Statistics for [[REDACTED-EX B4]]"
102+
}
103+
]
104+
}
105+
~~~

0 commit comments

Comments
 (0)