You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/glossary.md
+11-2Lines changed: 11 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -6,12 +6,21 @@ The following is a glossary of domain specific terminology. Although benchmarks
6
6
7
7
***metric**: a name of a quantifiable metric being measured (e.g., instruction count).
8
8
***artifact**: a specific rustc binary labeled by some identifier tag (usually a commit sha or some sort of human readable id like "1.51.0" or "test").
9
+
***benchmark suite**: an entire collection of benchmarks, either compile-time or runtime.
9
10
10
11
## Compile-time benchmark terms
11
12
12
13
***benchmark**: the source of a crate which will be used to benchmark rustc. For example, ["hello world"](https://github.com/rust-lang/rustc-perf/tree/master/collector/compile-benchmarks/helloworld).
13
-
***profile**: a [cargo profile](https://doc.rust-lang.org/cargo/reference/profiles.html). Note: the database uses "opt" whereas cargo uses "release".
14
-
***scenario**: The scenario under which a user is compiling their code. Currently, this is the incremental cache state and an optional change in the source since last compilation (e.g., full incremental cache and a `println!` statement is added).
14
+
***profile**: a compilation configuration.
15
+
-`check` corresponds to running `cargo check`.
16
+
-`debug` corresponds to running `cargo build`.
17
+
-`opt` corresponds to running `cargo build --release`.
18
+
-`doc` corresponds to running rustdoc.
19
+
***scenario**: describes the incremental cache state and an optional change in the source since last compilation.
20
+
-`full`: incremental compilation is not used.
21
+
-`incr-full`: incremental compilation is used, with an empty incremental cache.
22
+
-`incr-unchanged`: incremental compilation is used, with a full incremental cache and no code changes made.
23
+
-`incr-patched`: incremental compilation is used, with a full incremental cache and some code changes made.
15
24
***category**: a high-level group of benchmarks. Currently, there are three categories, primary (mostly real-world crates), secondary (mostly stress tests), and stable (old real-world crates, only used for the dashboard).
0 commit comments