Skip to content

Generate archive of historical analysis data #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 12 commits into from
Jul 12, 2023
Merged

Generate archive of historical analysis data #62

merged 12 commits into from
Jul 12, 2023

Conversation

andrewbranch
Copy link
Collaborator

This adds a package @arethetypeswrong/history, generated by a script that runs the core analysis on each package in npm-high-impact at different points in time. (Specifically, it generates analysis for the latest version of each package for its latest version available on the first of every month since January 2022. --moduleResolution nodenext was first released to stable versions of TypeScript in May of 2022, so there’s no need to go further back than this.) The result is a large archive of data that can be used to analyze how TS-compatible the most important npm packages are, and how that’s changing over time.

The generated analysis is saved as a 1.2 GB newline-delimited JSON file, cached in Azure Storage for incremental updates going forward, and compressed down to an incredible 34 MB to be shipped in the npm package. A small JavaScript interface decompresses the file and provides access to a POJO. I anticipate including smaller bundleable reduced datasets in the future, perhaps to allow trends in the data to be explored via web UI.

@changeset-bot
Copy link

changeset-bot bot commented Jul 12, 2023

⚠️ No Changeset found

Latest commit: b64a42a

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@andrewbranch andrewbranch merged commit 742758c into main Jul 12, 2023
@andrewbranch andrewbranch deleted the history branch July 12, 2023 04:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant