-
Notifications
You must be signed in to change notification settings - Fork 274
enable --validate-goto-model for all cbmc regressions #3661
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
regression/cbmc/Makefile
Outdated
@@ -1,13 +1,12 @@ | |||
default: tests.log | |||
|
|||
test: | |||
@../test.pl -p -c ../../../src/cbmc/cbmc -X smt-backend | |||
test: tests.log |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is tempting, but I think it's wrong: we do not have proper dependency tracking here (tests should be re-run whenever either the binary or the tests themselves change).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok, I'll simply make "test" the default target.
Sounds great if we can turn this on. One issue we've discovered recently is with the symbol checks that form part of
currently fails if passed through
which I suspect is accounting for a large number of the CI failures when this option is enabled.... |
This particular |
So #3193 added a test that : |
@chrisr-diffblue I can well imagine a few more cases where we might use suffixes on the identifier to disambiguate; say we are doing that for C++ and Java method overloading. |
26b9b4a
to
74722af
Compare
@kroening So can we enumerate what makes a symbol 'well formed' ? We can remove this suffix check if that's not something that we expect to hold, which would leave 'well formed' simply being "has a mode". |
74722af
to
0f66da3
Compare
6e46bca
to
745351e
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🚫
This PR failed Diffblue compatibility checks (cbmc commit: 745351e).
Build URL: https://travis-ci.com/diffblue/test-gen/builds/96270244
Status will be re-evaluated on next push.
Please contact @peterschrammel, @thk123, or @allredj for support.
Common spurious failures:
- the cbmc commit has disappeared in the mean time (e.g. in a force-push)
- the author is not in the list of contributors (e.g. first-time contributors).
The incompatibility may have been introduced by an earlier PR. In that case merging this
PR should be avoided unless it fixes the current incompatibility.
This will prevent the introduction of changes that violate the checks in the goto-validation procedure.
745351e
to
9849491
Compare
This has been merged as part of #3767. |
This will prevent the introduction of changes that violate the checks
in the goto-validation procedure.
This will need more work to actually pass CI; at the moment, basically all tests fail.