Skip to content

BLD: Send Travis-CI results to ScatterCI #5893

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
1 commit merged into from Jan 9, 2014
Merged

BLD: Send Travis-CI results to ScatterCI #5893

1 commit merged into from Jan 9, 2014

Conversation

ghost
Copy link

@ghost ghost commented Jan 9, 2014

Our CI situation could be better. Travis is great but doesn't do windows or 32 bit, the SPARC
buildbot provided by @yarikoptic lives in another location and the windows jenkins box isn't
publicly viewable. That means 🔴 builds have been going unnoticed, sometimes for months
until it's time to do a release and we inevitably go spelunking through commits from 2 months
ago to find the problem.

Each platform features some uncorrelated failures so grabbing as much as we can will improve
our overall testing coverage.

To address these types of problems, I've started working on a side-project called ScatterCI.
You can check out the beta version here: screenshot - 01092014 - 04 44 52 pm.

This PR should start getting travis jobs on the status page and the windows jenkins box already
submits results from it's nightlies.

If you hit problems with the status page, please open an issue up on the ScatterCI-Pandas repo, not here.
It's not a Pandas thing just a service useful to the project.

@yarikoptic, @neirbowj if you're interested, I can send you an API key and have you
and your favorite platform join the CI fun. It should just take a few minutes to setup and
a full-blown CI server is not even required, a nightly cron job would work just as well.

@yarikoptic
Copy link
Contributor

sounds interesting and useful. I can't promise immediate action but if you provide a brief howto and the key I might well enable reporting back from that sparc box

@jreback
Copy link
Contributor

jreback commented Jan 9, 2014

+1 !

@ghost
Copy link
Author

ghost commented Jan 9, 2014

@yarikoptic , you've got mail.

ghost pushed a commit that referenced this pull request Jan 9, 2014
BLD: Send Travis-CI results to ScatterCI
@ghost ghost merged commit aff887f into pandas-dev:master Jan 9, 2014
@ghost ghost deleted the PR_ScatterCI branch January 9, 2014 15:53
@jreback
Copy link
Contributor

jreback commented Jan 9, 2014

@y-p looks real nice..

minor issue...i have to click left of the 'builds | platforms' (and not on the arrow) to open...?

@ghost
Copy link
Author

ghost commented Jan 9, 2014

Just fixed it a few minutes ago. Try now?

@jreback
Copy link
Contributor

jreback commented Jan 9, 2014

beautiful!

now for the feature request!!

you are printing the output on a filed build, maybe have someway to show the config as well (like on a good build)...maybe another icon?
of course their are skipped tests to show too....

@ghost
Copy link
Author

ghost commented Jan 9, 2014

re config, Look again.

I'll keep the other suggestion in mind.

@neirbowj
Copy link
Contributor

neirbowj commented Jan 9, 2014

@y-p: This looks very promising. I would love to try setting up a buildbot, but I won't have time for that until at least mid-February. Would you like to send me an API key now, and have me sit on it a bit, or shall I send up a flare when I've got some time?

@ghost
Copy link
Author

ghost commented Jan 9, 2014

a dedicated CI box isn't required (but would be great), even a nightly cron (if you don't want to tie up a cpu)
would still be an improvement.

Ping me when you'd like to give it a try and I'll send you an email with everything.

@cpcloud
Copy link
Member

cpcloud commented Jan 9, 2014

The error output is kind of awesome 👍

@jtratner
Copy link
Contributor

Awesome! Can I set it to email me or something like that?

@ghost
Copy link
Author

ghost commented Jan 10, 2014

I plan to have it mail notifications to a mailing list so anyone could opt in.

@ghost
Copy link
Author

ghost commented Jan 18, 2014

ping @yarikoptic, SPARC builds started failing again sometime in the last week, It
would really help if you send the buildbot job reports to the ScatterCI server.
I guarantee it'll make things easier for everyone. If there are any technical issues,
I'm glad to help.

@yarikoptic
Copy link
Contributor

probably just time/personal difficulties... I will try to set it up
within a week... if you could provide a patch against
http://github.com/nipy/nibotmi that would "rush it up"

On Sat, 18 Jan 2014, y-p wrote:

ping [1]@yarikoptic, SPARC builds started failing again sometime in the
last week, It
would really help if you send the buildbot job reports to the ScatterCI
server.
I guarantee it'll make things easier for everyone. If there are any
technical issues,
I'm glad to help.


Reply to this email directly or [2]view it on GitHub.

References

Visible links

  1. https://github.com/yarikoptic
  2. BLD: Send Travis-CI results to ScatterCI #5893 (comment)

Yaroslav O. Halchenko, Ph.D.
http://neuro.debian.net http://www.pymvpa.org http://www.fail2ban.org
Senior Research Associate, Psychological and Brain Sciences Dept.
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834 Fax: +1 (603) 646-1419
WWW: http://www.linkedin.com/in/yarik

@ghost
Copy link
Author

ghost commented Jan 19, 2014

Thanks @yarikoptic. Blind config changes are low-probability-of-intercept
and setting up a buildbot seems like a painful task.

I've rearranged things a bit, and the script we use for travis is
now a self-contained example of what needs to run, with comments.
Just fill in the envars.

https://github.com/pydata/pandas/blob/master/ci/after_script.sh

Hope that helps a little.

@hayd
Copy link
Contributor

hayd commented Apr 3, 2014

Has Scatter-CI been moved? or is it no more?

@jreback
Copy link
Contributor

jreback commented Apr 3, 2014

its no more... @y-p has shall we say, removed himself entirely from the pandas loop. he felt his opinions were not being hear I think.

@cpcloud
Copy link
Member

cpcloud commented Apr 3, 2014

i'm sorry to hear that ... learned a lot from him

@hayd
Copy link
Contributor

hayd commented Apr 4, 2014

Sorry to hear this also. I hope he'll consider returning in the future...

This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants