You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Jun 18, 2024. It is now read-only.
Copy file name to clipboardExpand all lines: catalog.md
+5-5
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ This section provides further guidance and explanation for implementing the agen
10
10
/Data Requirements
11
11
------------------
12
12
13
-
The Open Data Policy requires agencies to list and describe all agency data that *can* be made publicly available (i.e. there are no valid restrictions to release) in a publicly available open data catalog with [common core metadata](http://project-open-data.github.io/schema/). It further requires the catalog to be human-readable and machine-readable. This guidance describes to agencies steps for implementing this portion of the policy.
13
+
The Open Data Policy requires agencies to list and describe all agency data that *can* be made publicly available (i.e. there are no valid restrictions to release) in a publicly available open data catalog with [common core metadata](/schema/). It further requires the catalog to be human-readable and machine-readable. This guidance describes to agencies steps for implementing this portion of the policy.
14
14
15
15
Why this effort
16
16
---------------
@@ -26,12 +26,12 @@ Each agency will describe their existing datasets as they see fit using the belo
26
26
Machine-Readable Format
27
27
-----------------------
28
28
29
-
All information deemed "machine-readable" required in this policy must be described in the JSON file format, with the option of RDFa Lite and XML as well. See [this specification](http://project-open-data.github.io/schema/) for the required schema. Agencies must post their files at agency.gov/data.json (and optionally at /data.html or data.xml as well). Additionally, the web page which reads and formats these files must be posted at /data/index.html (or data.html). The files should be updated a minimum of monthly. It is our intent that future publications of Data.gov will simply crawl for all agency.gov/data.json to populate Data.gov.
29
+
All information deemed "machine-readable" required in this policy must be described in the JSON file format, with the option of RDFa Lite and XML as well. See [this specification](/schema/) for the required schema. Agencies must post their files at agency.gov/data.json (and optionally at /data.html or data.xml as well). Additionally, the web page which reads and formats these files must be posted at /data/index.html (or data.html). The files should be updated a minimum of monthly. It is our intent that future publications of Data.gov will simply crawl for all agency.gov/data.json to populate Data.gov.
30
30
31
31
Implementing
32
32
------------
33
33
34
-
To fulfill the requirements of this memorandum, agencies should begin to describe datasets as a catalog using the vocabulary of the [common core metadata](http://project-open-data.github.io/schema/). This catalog is to be published in two places. First, as a standalone JSON file at `agency.gov/data.json` and second with RDFa Lite, either embedded within a HTML page which include human readable markups (e.g., `agency.gov/data.html`) or as an XML file (e.g., `agency.gov/data.xml`).
34
+
To fulfill the requirements of this memorandum, agencies should begin to describe datasets as a catalog using the vocabulary of the [common core metadata](/schema/). This catalog is to be published in two places. First, as a standalone JSON file at `agency.gov/data.json` and second with RDFa Lite, either embedded within a HTML page which include human readable markups (e.g., `agency.gov/data.html`) or as an XML file (e.g., `agency.gov/data.xml`).
35
35
36
36
### JSON
37
37
@@ -47,7 +47,7 @@ The JSON representation of the catalog should track directly to the RDFa version
47
47
Generating Machine-Readable Reporting Files
48
48
-------------------------------------------
49
49
50
-
Agencies must follow the provided [specification](http://project-open-data.github.io/schema/). We have built a [catalog generator](http://project-open-data.github.com/catalog-generator/) to assist you in building your catalog and generating JSON, XML, or RDFa Lite files.
50
+
Agencies must follow the provided [specification](/schema/). We have built a [catalog generator](http://project-open-data.github.com/catalog-generator/) to assist you in building your catalog and generating JSON, XML, or RDFa Lite files.
51
51
52
52
Presentation
53
53
------------
@@ -58,7 +58,7 @@ Agencies must have present a table/list of each dataset in the /data page. The
58
58
* Dataset description
59
59
* URL to the dataset (endpoint)
60
60
61
-
The page must be populated from the machine-readable catalog file (e.g. data.xml or data.json) following the [specification](http://project-open-data.github.io/schema/) described above. Agencies are encouraged to add functionality to assist end-user discoverability. Additional functions might be sorting, filtering or paging to help make a more digestible list. Agencies are also encouraged to add more to the standard schema which might further assist end-user discoverability and usability (e.g. thumbnails).
61
+
The page must be populated from the machine-readable catalog file (e.g. data.xml or data.json) following the [specification](/schema/) described above. Agencies are encouraged to add functionality to assist end-user discoverability. Additional functions might be sorting, filtering or paging to help make a more digestible list. Agencies are also encouraged to add more to the standard schema which might further assist end-user discoverability and usability (e.g. thumbnails).
Copy file name to clipboardExpand all lines: faq.md
+4-4
Original file line number
Diff line number
Diff line change
@@ -92,7 +92,7 @@ While ISO 32000 is an open standard, the Portable Document Format (PDF) does not
92
92
93
93
### What is the relationship of the metadata standard (specifically) to NIEM, ISE, FGDC, and other existing (especially official) government data standards?
94
94
95
-
The [common core metadata schema](http://project-open-data.github.io/schema/) is based on existing vocabularies and easily mapped to NIEM, Information Sharing Environment, and FGDC.
95
+
The [common core metadata schema](/schema/) is based on existing vocabularies and easily mapped to NIEM, Information Sharing Environment, and FGDC.
96
96
97
97
### What is a "persistent identifier"?
98
98
@@ -104,9 +104,9 @@ The core metadata schema was the result of recommendations from a government-wid
104
104
105
105
### How can I recommend changes and improvements to the metadata schema?
106
106
107
-
Submit a pull request for the [metadata schema](http://project-open-data.github.io/schema/).
107
+
Submit a pull request for the [metadata schema](/schema/).
108
108
109
-
### Can I extend the metadata schema beyond the terms specified in the [common core metadata schema](http://project-open-data.github.io/schema/)?
109
+
### Can I extend the metadata schema beyond the terms specified in the [common core metadata schema](/schema/)?
110
110
111
111
Yes, if your data management process includes rich metadata specific to the mission of your agency or the Line of Business your agency participates, publishing additional metadata that makes your data more useful to the public is welcomed and encouraged. Note that Data.gov will be harvesting only the metadata in this published schema unless specific arrangements are in place (e.g. geospatial FGDC/ISO).
112
112
@@ -157,7 +157,7 @@ A wide variety of tools are available to manage a data catalog, whether public-f
157
157
158
158
### What formats are required/recommended for the agency.gov/data file?
159
159
160
-
There are several syntaxes that may be used when publishing the data file. The syntax that is required to make the data readily available to developers is JSON (JavaScript Object Notation). It is recommended that agencies also create a data.html file and use RDFa Lite (Resource Description Framework) to mark-up the metadata using the [common core metadata schema](http://project-open-data.github.io/schema/). The RDFa Lite file can be easily consumed by major search engines and applications and make you data easier to find by the public. A third alternative for populating your metadata file is XML (eXtensible Markup Language). Agencies are encouraged to maintain all three version of the metadata file. [Tools](http://labs.data.gov) are available to transform any instance of the file into the alternative formats.
160
+
There are several syntaxes that may be used when publishing the data file. The syntax that is required to make the data readily available to developers is JSON (JavaScript Object Notation). It is recommended that agencies also create a data.html file and use RDFa Lite (Resource Description Framework) to mark-up the metadata using the [common core metadata schema](/schema/). The RDFa Lite file can be easily consumed by major search engines and applications and make you data easier to find by the public. A third alternative for populating your metadata file is XML (eXtensible Markup Language). Agencies are encouraged to maintain all three version of the metadata file. [Tools](http://labs.data.gov) are available to transform any instance of the file into the alternative formats.
Copy file name to clipboardExpand all lines: governance.md
+2-2
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ filename: governance.md
6
6
---
7
7
8
8
### Background
9
-
[Project Open Data](http://project-open-data.github.com), a new White House resource, is an online collection of code, best practices, and case studies developed to help agencies adopt the framework presented in the memorandum on “Managing Government Information as an Asset to Promote Interoperability and Openness.” Project Open Data will evolve over time as a community resource to facilitate adoption of open data practices. To facilitate collaboration across the Federal Government and in partnership with public developers, the Project is published on the developer social network GitHub.
9
+
[Project Open Data](/), a new White House resource, is an online collection of code, best practices, and case studies developed to help agencies adopt the framework presented in the memorandum on “Managing Government Information as an Asset to Promote Interoperability and Openness.” Project Open Data will evolve over time as a community resource to facilitate adoption of open data practices. To facilitate collaboration across the Federal Government and in partnership with public developers, the Project is published on the developer social network GitHub.
10
10
11
11
As the Project founder, the White House is dedicated to maximizing openness, participation, and collaboration while ensuring the integrity of the resources hosted within the Project. This page provides information on ways to participate in the Project and how the White House will govern it.
12
12
@@ -40,7 +40,7 @@ Ultimately? You. While the White House founded and continues to oversee the proj
40
40
At the onset, the General Services Administration is here to provide daily oversight and support, but over time, it is our vision that contributors both inside and outside of government can be empowered to take on additional leadership roles.
41
41
42
42
**Can I use the project's content or source code elsewhere?**
43
-
The project [as originally published](http://project-open-data.github.io/) constitutes a work of the United States Government and is not subject to domestic copyright protection under 17 USC § 105. Subsequent contributions by members of the public, however, retain their original copyright.
43
+
The project [as originally published](/) constitutes a work of the United States Government and is not subject to domestic copyright protection under 17 USC § 105. Subsequent contributions by members of the public, however, retain their original copyright.
44
44
In order to better facilitate collaboration, the content of this project is licensed under the [Creative Commons 3.0 License](http://creativecommons.org/licenses/by/3.0/us/deed.en_US), and the underlying source code used to format and display that content is licensed under the [MIT License](http://opensource.org/licenses/mit-license.php).
Copy file name to clipboardExpand all lines: implementation-guide.md
+6-6
Original file line number
Diff line number
Diff line change
@@ -13,7 +13,7 @@ Maintain a complete listing of all datasets owned, managed, collected, and/or cr
13
13
14
14
### A) Minimum Required for Compliance
15
15
16
-
Produce a single catalog or list of data managed in a single table, workspace, or other relevant location. Describe each dataset according to the [common core metadata](http://project-open-data.github.io/schema/).
16
+
Produce a single catalog or list of data managed in a single table, workspace, or other relevant location. Describe each dataset according to the [common core metadata](/schema/).
17
17
18
18
This listing can be maintained in a Data Management System (DMS) such as the open-source [CKAN](http://www.ckan.org) platform; a single spreadsheet, with each metadata field as its own column; or a DMS of your choosing.
19
19
@@ -38,7 +38,7 @@ While agencies are only required to list datasets with an "Access Level" value o
38
38
39
39
Document any datasets or metadata in your enterprise data inventory that your agency does not believe can be made publicly available, in consultation with your Office of General Counsel or its equivalent.
40
40
41
-
Publish your agency’s enterprise data inventory, with the aforementioned information removed, to a file located at [agency].gov/data.json and described using (at minimum) the [common core metadata](http://project-open-data.github.io/schema/). This file itself must be listed as a dataset within itself (see [an example of format](http://project-open-data.github.io/examples/catalog-sample-extended.json) ); if you have multiple data.json files across your agency, include all of them in the top-level data.json at agency.gov/data.json.
41
+
Publish your agency’s enterprise data inventory, with the aforementioned information removed, to a file located at [agency].gov/data.json and described using (at minimum) the [common core metadata](/schema/). This file itself must be listed as a dataset within itself (see [an example of format](/examples/catalog-sample-extended.json) ); if you have multiple data.json files across your agency, include all of them in the top-level data.json at agency.gov/data.json.
42
42
43
43
While you could manually create this file in a text editor, it is recommended that you use one of the tools provided to generate this file automatically from your existing DMS or enterprise inventory file.
44
44
@@ -51,7 +51,7 @@ While you could manually create this file in a text editor, it is recommended th
51
51
52
52
### C) Best Practices and Examples
53
53
54
-
* Using the [common core metadata](http://project-open-data.github.io/schema) to describe your enterprise data inventory makes it very simple to use that inventory for your public inventory.
54
+
* Using the [common core metadata](/schema) to describe your enterprise data inventory makes it very simple to use that inventory for your public inventory.
55
55
* A detailed and descriptive title, description, and set of keywords for each dataset is the difference between customers finding your data and no one finding your data. Since agency data catalogs are harvested and searchable on Data.gov, accurate and thorough metadata is the best way to connect customers with your data.
56
56
* Consider including restricted and non-public datasets in your public data inventory listing. Remember that this file contains metadata about the data and not the data themselves.
57
57
* When you include restricted datasets in your public data inventory, include specific information on how customers can request and qualify for access to those data.
@@ -77,7 +77,7 @@ Create a process to solicit feedback from customers about existing and potential
77
77
78
78
### B) Best Practices and Examples
79
79
80
-
* The required set of [common core metadata](http://project-open-data.github.io/schema/) includes fields for a contact name (“person”) and an email address (“mbox”). Listing specific, accurate information in these fields for each dataset ensures that customers can give direct feedback on a dataset to the person who is most likely to be able to act on that feedback.
80
+
* The required set of [common core metadata](/schema/) includes fields for a contact name (“person”) and an email address (“mbox”). Listing specific, accurate information in these fields for each dataset ensures that customers can give direct feedback on a dataset to the person who is most likely to be able to act on that feedback.
81
81
* If you enable customers to leave comments on datasets, ensure someone at your agency monitors these comments and responds in a timely manner. When new visitors see outdated, unanswered comments, they are less likely to provide feedback.
82
82
83
83
@@ -163,7 +163,7 @@ Collect or create information (data) in a way that supports downstream informati
163
163
### A) Minimum Required for Compliance
164
164
165
165
* Review information for privacy, confidentiality pledge, security, and other restrictions to release.
166
-
* Make the data available in a machine-readable format. See [this list](http://project-open-data.github.io/faq.md) of commonly accepted machine-readable formats. Where appropriate, provide access to the data via an API.
166
+
* Make the data available in a machine-readable format. See [this list](/faq.md) of commonly accepted machine-readable formats. Where appropriate, provide access to the data via an API.
167
167
* Post the data files in an Internet-accessible location, listing this location the dataset’s entry in your agency inventory listing.
168
168
169
169
### B) Tools
@@ -185,7 +185,7 @@ New, or significantly modified, information systems need to support interoperabi
185
185
186
186
* Ensure the system can export data in a machine-readable format.
187
187
* Ensure data is separated from the application layer of the system to maximize future export and/or reuse of the data.
188
-
* Store and export data using open data standards whenever possible, including the [common core metadata](http://project-open-data.github.io/schema/) required by this Memorandum.
188
+
* Store and export data using open data standards whenever possible, including the [common core metadata](/schema/) required by this Memorandum.
189
189
* Document all data schemas and dictionaries used by the system.
Copy file name to clipboardExpand all lines: policy-memo.md
+1-1
Original file line number
Diff line number
Diff line change
@@ -76,7 +76,7 @@ This attachment provides definitions and implementation guidance for M-13-13, *O
76
76
77
77
**Managed Post-Release.* A point of contact must be designated to assist with data use and to respond to complaints about adherence to these open data requirements.
78
78
79
-
**Project Open Data:* "Project Open Data," a new OMB and OSTP resource, is an online repository of tools, best practices, and schema to help agencies adopt the framework presented in this guidance. Project Open Data can be accessed at [project-open-data.github.io](http://project-open-data.github.io).[^18] Project Open Data will evolve over time as a community resource to facilitate adoption of open data practices. The repository includes definitions, code, checklists, case studies, and more, and enables collaboration across the Federal Government, in partnership with public developers, as applicable. Agencies can visit Project Open Data for a more comprehensive glossary of terms related to open data.
79
+
**Project Open Data:* "Project Open Data," a new OMB and OSTP resource, is an online repository of tools, best practices, and schema to help agencies adopt the framework presented in this guidance. Project Open Data can be accessed at [project-open-data.github.io](/).[^18] Project Open Data will evolve over time as a community resource to facilitate adoption of open data practices. The repository includes definitions, code, checklists, case studies, and more, and enables collaboration across the Federal Government, in partnership with public developers, as applicable. Agencies can visit Project Open Data for a more comprehensive glossary of terms related to open data.
0 commit comments