BLD: add shiningpanda integration for windows builds?

[jreback]

https://www.shiningpanda-ci.com/

[cpcloud]

sexy. plus they are called panda

[cpcloud]

could probably get the travis data and predict the cost of windows builds if the speed is at all similar to linux...useful?

[ghost]

cc @wesm. The IPython guys use it for windows testing, btw.

I know there's a jenkins box somewhere, but it's not visible to the rest of the devs.

[wesm]

probably a good idea. the solution of "a box in the corner of our office" isn't a great solution as it requires chang or me to twiddle it if there are problems. Getting remote desktop working would be a decent solution but a hosted service would be better

[jtratner]

Looks like it's not free like Travis though, at least not for Windows.
(they offer about 10hrs of build time for free for OSS, so that's about 30
individual builds per month (and if we stick to building 3 versions, then
it's only 10 builds)
On Jun 19, 2013 3:54 PM, "Wes McKinney" [email protected] wrote:

probably a good idea. the solution of "a box in the corner of our office"
isn't a great solution as it requires chang or me to twiddle it if there
are problems. Getting remote desktop working would be a decent solution but
a hosted service would be better

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/3958#issuecomment-19710233
.

[jtratner]

@wesm maybe this would be a short-term measure to handle windows builds for now (at least in terms of getting periodic testing set up so we catch Windows test failures earlier).

[wesm]

Maybe. we should start figuring out the long term solution ASAP...we can't
be the only library with this problem

On Fri, Nov 8, 2013 at 10:54 AM, Jeff Tratner [email protected]:

@wesm https://github.com/wesm maybe this would be a short-term measure
to handle windows builds for now (at least in terms of getting periodic
testing set up so we catch Windows test failures earlier).

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/3958#issuecomment-28087628
.

[ghost]

@wesm, what are you looking for here? what is the problem other projects are solving
and pandas isn't?

Windows CI would cut down on broken binary builds, a public buildbox would let others
remotely debug IT issues on it. If you want others to handle the uploading of artifacts to
the release channels (pypi, website) you'll need to give someone else access.

Explain what's needed, we'll help.

[cpcloud]

I tried getting a CI build for windows thru bitbucket's bamboo (they offer it for free to open source), but I dropped the ball a bit. I can start that up again. Would that help?

[wesm]

@y-p, well, we need all 8 combinations of the following:

• Python 2.6, 2.7, 3.2, 3.3
• 32- and 64-bit

@jseabold and @josef-pkt you must have this problem with statsmodels as well. same goes for @ogrisel and the scikit-learn folks.

the CI environment would hopefully have all the optional dependencies sufficient to run the full unit test suite. I can say from experience that rolling a Windows VM for CI purposes from scratch with All The Things is not a small task and unfortunately Microsoft doesn't make it easy on us.

I can offer financial support for this work (i.e. I will pay someone for their time--Bitcoin, USD, whatever you want -- to set something sustainable up for the pandas--and hopefully beyond--dev community). Gods know that pandas has been good to me and even if the money comes out of my own pocket it's a fair trade.

I also have all of the windows software through Microsoft's B!zSpark program and can give ISOs and license keys to the people who need them.

[jseabold]

I shelled out some money for a cheap, old 'box in the corner' solution for nightly builds for statsmodels. It's not CI, LAN access only, and it doesn't run any tests, but if the build code would help anyone come up with a more permanent solution, it's here.

https://github.com/statsmodels/binary_builds
http://statsmodels.sourceforge.net/binaries/

[jtratner]

I ended up mentioning this to Bradley from Continuum / NumFocus and he
suggested setting up a Jenkins CI server for NumFocus projects. Maybe we
could get builds from that too. Wouldn't need to do it as frequently as
Travis to be useful. I still need to follow up in an email. Would that
cover our needs here?

[jtratner]

To be clear, he's offering to manage it too.

[josef-pkt]

Skipper was doing all the hard work with Microsoft compilers, I'm doing all my development on Windows, including testing across python versions. Because we don't have many extensions, I haven't seen any 32bit versus 64bit issues, AFAIR.

[wesm]

@jtratner I mean, I've stated the requirements very clearly above so if they can provide that then that would be amazing. It would be preferable to have nightly builds posted to the pandas website like we have had (when it's working). I don't know why we don't have a community-accessible system like Christophe Gohlke's site (I know the answer why not, because it's a PITA!)

[wesm]

CRAN still has us way outclassed in this department

[jtratner]

Okay - just wanted to make sure I understood. I'll write up an email and
see what they see.

I also heard talk that Continuum's Binstar might handle builds, but all
your deps have to follow their recipe format / be uploaded too.

[jtratner]

now I get what you meant - completely missed the comment where you laid out everything you wanted :P

[jreback]

this is the thread discussing

groups.google.com/forum/m#!msg/numfocus/mVNakFqfpZg/m7b13PZEW1YJ

[jtratner]

Not exactly the same thing (in that Bradley was saying he might be able to
do it), and it seems a bit broader in scope (i.e., all packages as
opposed to just those under NumFocus umbrella), but he still hasn't
responded to my email.

[jtratner]

but it'd certainly cover our needs.

[ghost]

We're covered by #5893 as long as there's a windows jenkins box participating.