Skip to content

TST: add test to read empty array #43459

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Sep 29, 2021
Merged

TST: add test to read empty array #43459

Changes from 3 commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
b9ecdb6
TST: add test to read zero-chunked array
nakatomotoi Sep 8, 2021
427eee1
Modify: change test function
nakatomotoi Sep 8, 2021
6419677
Modify: add several dtypes
nakatomotoi Sep 12, 2021
a48a0a5
Modify: set dtypes by @pytest.mark.parametrize
nakatomotoi Sep 14, 2021
e72733c
Modify: add Int64 and UInt8
nakatomotoi Sep 14, 2021
38fa455
Modify: add comment of original issue number
nakatomotoi Sep 15, 2021
242c81d
Modify: add use_nullable_dtypes as read_kwargs
nakatomotoi Sep 15, 2021
74154ad
Modify: add boolean
nakatomotoi Sep 15, 2021
d1e114f
Modify: remove use_nullable_dtypes
nakatomotoi Sep 19, 2021
e71e2a5
Merge branch 'master' into add-read-parquet-test
nakatomotoi Sep 22, 2021
58580ed
Merge branch 'master' of https://github.com/pandas-dev/pandas into ad…
nakatomotoi Sep 24, 2021
90b7942
Modify: add float, int, period[D], Float64 and string
nakatomotoi Sep 24, 2021
9fe7498
Modify: move test near test_use_nullable_dtypes
nakatomotoi Sep 26, 2021
d738905
Merge branch 'master' into add-read-parquet-test
nakatomotoi Sep 26, 2021
9f3be07
Merge branch 'master' into add-read-parquet-test
nakatomotoi Sep 28, 2021
4aa7027
Merge branch 'master' into add-read-parquet-test
nakatomotoi Sep 29, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions pandas/tests/io/test_parquet.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -931,6 +931,17 @@ def test_read_parquet_manager(self, pa, using_array_manager):
else:
assert isinstance(result._mgr, pd.core.internals.BlockManager)

def test_read_empty_array(self, pa):
df = pd.DataFrame(
{
"a": pd.array([], dtype="Int64"),
"b": pd.array([], dtype="UInt8"),
"c": pd.array([], dtype="string"),
"d": pd.array([], dtype="boolean"),
}
)
check_round_trip(df, pa)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need to add read_kwars={'use_nullable_types': True}


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

move this test near here:

     def test_use_nullable_dtypes(self, engine):
        import pyarrow.parquet as pq

        if engine == "fastparquet":
            # We are manually disabling fastparquet's
            # nullable dtype support pending discussion
            pytest.skip("Fastparquet nullable dtype support is disabled")

and in fact structure it similarly


class TestParquetFastParquet(Base):
def test_basic(self, fp, df_full):
Expand Down