You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.developers.md
+21-42Lines changed: 21 additions & 42 deletions
Original file line number
Diff line number
Diff line change
@@ -183,7 +183,7 @@ Python files are automatically checked using `pylint` to ensure they follow esta
183
183
184
184
VTR has a variety of tests which are used to check for correctness, performance and Quality of Result (QoR).
185
185
186
-
There are 4 main regression tests:
186
+
There are 4 main regression testing suites:
187
187
188
188
*`vtr_reg_basic`: ~1 minute serial
189
189
@@ -216,54 +216,33 @@ There are 4 main regression tests:
216
216
217
217
QoR checks in this regression test are primarily 'canary' checks to catch gross degradations in QoR.
218
218
Occasionally, changes can cause QoR failures (e.g. due to CAD noise -- particularly on small benchmarks); usually such failures are not a concern if the QoR differences are small.
**Architectures:** A wider variety of architectures
263
-
264
-
QoR checks in this regression are aimed at evaluating quality and run-time of the VTR flow.
265
-
As a result any QoR failures are a concern and should be investigated and understood.
266
-
236
+
Note:
237
+
238
+
These suites comproise a single large suite, `vtr_reg_nightly` and should be run together to test nightly level regression. They are mostly similar in benchmark coverage interms of size and diversity however each suite tests some unique benchmarks in addition to the VTR benchmarks.
239
+
240
+
| suite | wall-clock time| Additional benchmarks|
241
+
|-------|----------------|----------------------|
242
+
|vtr_reg_nightly_test1|~4.5 hours with `-j8`|ISPD and MCNC20 |
243
+
|vtr_reg_nightly_test2|~6 hours with `-j8`|Titan23 and Titan `other`|
244
+
|vtr_reg_nightly_test3|~5.5 hours with `-j8`|none|
0 commit comments