Skip to content

Fix epix_merge sync="truncate" err (with=F no j), add tests #215

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 23, 2022

Conversation

brookslogan
Copy link
Contributor

Also:

  • Add an internal warning + recovery if our DT preprocessing unexpectedly
    produces a DT with a different key (although in a way that won't catch if we
    accidentally mutated the original DT's key and matched it in the intermediate
    DT). If this is triggered, we will likely need to rethink/bugfix some other DT
    usage in other code which may have made similar assumptions about certain DT
    operations not dropping/modifying the key.
  • Edit the input to one set of epix_merge tests to make the truncate test more
    restrictive than it would have been otherwise, and edit a non-truncate test with
    an expected value that changes as a result.

Closes #200.

Also:
- Add an internal warning + recovery if our DT preprocessing unexpectedly
  produces a DT with a different key (although in a way that won't catch if we
  accidentally mutated the original DT's key and matched it in the intermediate
  DT). If this is triggered, we will likely need to rethink/bugfix some other DT
  usage in other code which may have made similar assumptions about certain DT
  operations not dropping/modifying the key.
- Edit the input to one set of epix_merge tests to make the truncate test more
  restrictive than it would have been otherwise, and edit a non-truncate test with
  an `expected` value that changes as a result.
@brookslogan brookslogan requested a review from dajmcdon as a code owner August 18, 2022 22:00
@brookslogan
Copy link
Contributor Author

brookslogan commented Aug 19, 2022

  • TODO: remove duplicated internal warning/error here.

@brookslogan brookslogan marked this pull request as draft August 19, 2022 13:50
@brookslogan brookslogan marked this pull request as ready for review August 19, 2022 22:24
@dajmcdon
Copy link
Contributor

LGTM. Feel free to merge.

@brookslogan brookslogan merged commit 66d1172 into main Aug 23, 2022
@brookslogan brookslogan deleted the lcb/fix-merge-truncate-data-table-with-false branch August 23, 2022 10:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Strange bug with sync="truncate" in epix_merge()
3 participants