-
-
Notifications
You must be signed in to change notification settings - Fork 18.4k
ENH/TST: Add quantile & mode tests for ArrowExtensionArray #47744
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
mroeschke
commented
Jul 15, 2022
•
edited
Loading
edited
- Tests added and passed if fixing a bug or adding a new feature
- All code checks passed.
msg = "Falling back on a non-pyarrow code path which may decrease performance." | ||
msg = ( | ||
"Falling back on a non-pyarrow code path which may decrease performance or " | ||
"not be fully compatible with pyarrow." |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there a specific reason for adding this additional sentence?
(since it is so generic, it's also not that useful / potentially confusing I think)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I also wanted to convey in this message that a user may get incorrect results if falling back.
e.g. A user's code could fall back to using ExtensionArray._mode/_quantile
which may have some numpy-based assumptions that may fail when passing arrow (or arrow transformed) data.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If we know (think?) that a certain fallback can give incorrect results, can we rather have it error in that case? (for that specific function)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah that's a good point. Okay I'll leave this message alone, and raise a NotImplementedError
for the associated case (mode/quantile)
32-bit test failing? |
Unrelated, but addressed at #47803 |
can u rebase |
Rebased |