Skip to content

powerpc: Test*Parser* fail with AssertionError: 2262-04-10T00:12:45.292707840+0000 != 2262-04-10T00:12:45.292707840+0000 #4292

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
yarikoptic opened this issue Jul 19, 2013 · 9 comments · Fixed by #4302
Closed

powerpc: Test*Parser* fail with AssertionError: 2262-04-10T00:12:45.292707840+0000 != 2262-04-10T00:12:45.292707840+0000 #4292

yarikoptic opened this issue Jul 19, 2013 · 9 comments · Fixed by #4302
Labels
Testing pandas testing functions or related to the test suite
Milestone
0.12

Comments

@yarikoptic
Copy link
Contributor

Detected by Debian build farm
https://buildd.debian.org/status/fetch.php?pkg=pandas&arch=powerpc&ver=0.12.0~rc1%2Bgit112-gb79996c-1&stamp=1374189622&file=log

======================================================================
FAIL: test_nat_parse (pandas.io.tests.test_parsers.TestCParserHighMemory)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/io/tests/test_parsers.py", line 607, in test_nat_parse
    tm.assert_frame_equal(result,df)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 238, in assert_frame_equal
    check_less_precise=check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 197, in assert_series_equal
    assert_almost_equal(left.values, right.values, check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 141, in assert_almost_equal
    assert_almost_equal(a[i], b[i], check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 172, in assert_almost_equal
    assert a == b, "%s != %s" % (a, b)
AssertionError: 2262-04-10T00:12:45.292707840+0000 != 2262-04-10T00:12:45.292707840+0000

======================================================================
FAIL: test_nat_parse (pandas.io.tests.test_parsers.TestCParserLowMemory)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/io/tests/test_parsers.py", line 607, in test_nat_parse
    tm.assert_frame_equal(result,df)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 238, in assert_frame_equal
    check_less_precise=check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 197, in assert_series_equal
    assert_almost_equal(left.values, right.values, check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 141, in assert_almost_equal
    assert_almost_equal(a[i], b[i], check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 172, in assert_almost_equal
    assert a == b, "%s != %s" % (a, b)
AssertionError: 2262-04-10T00:12:45.292707840+0000 != 2262-04-10T00:12:45.292707840+0000

======================================================================
FAIL: test_nat_parse (pandas.io.tests.test_parsers.TestPythonParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/io/tests/test_parsers.py", line 607, in test_nat_parse
    tm.assert_frame_equal(result,df)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 238, in assert_frame_equal
    check_less_precise=check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 197, in assert_series_equal
    assert_almost_equal(left.values, right.values, check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 141, in assert_almost_equal
    assert_almost_equal(a[i], b[i], check_less_precise)
  File "/«BUILDDIR»/pandas-0.12.0~rc1+git112-gb79996c/debian/tmp/usr/lib/python2.7/dist-packages/pandas/util/testing.py", line 172, in assert_almost_equal
    assert a == b, "%s != %s" % (a, b)
AssertionError: 2262-04-10T00:12:45.292707840+0000 != 2262-04-10T00:12:45.292707840+0000

good news -- those seems to be the only failures on powerpc (for python 2.7 at least, python 3 did not have chance to get any testing yet due to 2.7 failing)
@jtratner
Copy link
Contributor

is this current master?

@cpcloud
Copy link
Member

cpcloud commented Jul 19, 2013

@jtratner looks like 2 behind (b79996c), but last 2 are merge + y-p doc commit so should be ok

@yarikoptic
Copy link
Contributor Author

FWIW on s390 the same test fails too
https://buildd.debian.org/status/fetch.php?pkg=pandas&arch=s390x&ver=0.12.0~rc1%2Bgit112-gb79996c-1&stamp=1374197022&file=log
but then the whole build f.cks up somehow upon test_non_unique_loc_memory_error (yet to troubleshoot) and gets killed... so no details on failures and errors are provided

@jreback
Copy link
Contributor

jreback commented Jul 19, 2013

this is again a byteorder issue....

@jreback
Copy link
Contributor

jreback commented Jul 19, 2013

@yarikoptic

must be something weird going on....on the sparc machine....I can't even build master...it just hangs in the compiler (I turned off quiet)....and goes most of the way thru, but been spinning the cpu for a while (and not out of memory 10% being used)...its the compile step for algos.o....(its pretty large)...maybe that's an issue?
on python 2.7 stock build after I did scroot

any ideas?

@yarikoptic
Copy link
Contributor Author

well -- that box is quite antique by now (somewhere from 2000 or around), so a bit of extra patience would help ;) I just usually leave it building and come back to it later. also you might like to make use of installed ccache

I see that it now runs python3.2 for you - so I guess there was progress ;)

@jreback
Copy link
Contributor

jreback commented Jul 19, 2013

ok...will let it build (though 20 min still seems very odd to just compile a file)....

@jreback
Copy link
Contributor

jreback commented Jul 19, 2013

So the issue on that wrap around problem is happening
....let me see if I can fix this

(Pdb) p pd.NaT.value
-9223372036854775808L
(Pdb) p df['B'].iloc[3]
Timestamp('2262-04-11 23:47:16.854775807', tz=None)
(Pdb) p df['B'].iloc[3].value
9223372036854775807L

these are supposed to be the same

@jreback jreback mentioned this issue Jul 20, 2013
Merged
@jreback
Copy link
Contributor

jreback commented Jul 20, 2013

@yarikoptic pls give a retest....I think I found the problem...

as assignng nan to a M8[ns] numpy array, works fine (it assigns iNaT), the integer version of NaT on little endian. but doesn't work on big endian; so do a pre-convesion to catch this (which should have been done anyhow, as I suspect this is not a documented behavior)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Testing pandas testing functions or related to the test suite
Projects
None yet
Milestone
0.12
Development

Successfully merging a pull request may close this issue.

BUG: explicity change nan -> NaT when assigning to datelike dtypes jreback/pandas
4 participants
@yarikoptic @cpcloud @jreback @jtratner