Skip to content

BUG: value_counts not working correctly on ExtensionArrays #33674

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
May 1, 2020
Merged

BUG: value_counts not working correctly on ExtensionArrays #33674

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
11c26e2
BUG: value_counts not working correctly on ExtensionArrays
kotamatsuoka Apr 20, 2020
b025232
Change sum() to ndarray.sum()
kotamatsuoka Apr 20, 2020
7007205
Expand tests
kotamatsuoka Apr 21, 2020
af97126
Update test
kotamatsuoka Apr 22, 2020
cbabcad
Resolve warning
kotamatsuoka Apr 24, 2020
dac1af5
Pass test in Windows py36_np15
kotamatsuoka Apr 24, 2020
0be33fc
Change Int32 to Int64
kotamatsuoka Apr 25, 2020
660bba3
Merge branch 'master' into normalize-value-counts
kotamatsuoka Apr 25, 2020
d5eec76
Fix docs
kotamatsuoka Apr 25, 2020
db8ea2e
Remove product code update
kotamatsuoka Apr 25, 2020
243d3ec
Remove unnecessary changes
kotamatsuoka Apr 26, 2020
67ee980
split new test
kotamatsuoka Apr 27, 2020
405037f
Update normalize value_counts test
kotamatsuoka Apr 29, 2020
5d54a05
add coments
kotamatsuoka Apr 30, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions pandas/core/algorithms.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -724,6 +724,8 @@ def value_counts(
result = result.sort_values(ascending=ascending)

if normalize:
if not isinstance(counts, np.ndarray):
counts = counts.to_numpy()
result = result / float(counts.sum())

return result
Expand Down
10 changes: 10 additions & 0 deletions pandas/tests/arrays/string_/test_string.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -277,3 +277,13 @@ def test_value_counts_na():
result = arr.value_counts(dropna=True)
expected = pd.Series([2, 1], index=["a", "b"], dtype="Int64")
tm.assert_series_equal(result, expected)


def test_normalize_value_counts():
result = (
pd.Series(list("abcd"), dtype="string")
.value_counts(normalize=True)
.sort_index()
)
expected = pd.Series([0.25, 0.25, 0.25, 0.25], index=["a", "b", "c", "d"])
tm.assert_series_equal(expected, result)