Skip to content

Some CI improvements #2328

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Feb 5, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 21 additions & 1 deletion .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -58,9 +58,26 @@ jobs:
command: |
sudo cp /usr/share/zoneinfo/America/Anchorage /etc/localtime
- run:
name: Run jasmine tests
name: Run jasmine tests (batch 1)
command: ./.circleci/test.sh jasmine

test-jasmine2:
docker:
# need '-browsers' version to test in real (xvfb-wrapped) browsers
- image: circleci/node:8.9.4-browsers
working_directory: ~/plotly.js
steps:
- checkout
- attach_workspace:
at: ~/plotly.js
- run:
name: Set timezone to Alaska time (arbitrary timezone to test date logic)
command: |
sudo cp /usr/share/zoneinfo/America/Anchorage /etc/localtime
- run:
name: Run jasmine tests (batch 2)
command: ./.circleci/test.sh jasmine2

test-image:
docker:
- image: plotly/testbed:latest
Expand Down Expand Up @@ -100,6 +117,9 @@ workflows:
- test-jasmine:
requires:
- build
- test-jasmine2:
requires:
- build
- test-image:
requires:
- build
Expand Down
13 changes: 9 additions & 4 deletions .circleci/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,13 @@ EXIT_STATE=0
case $1 in

jasmine)
npm run test-jasmine || EXIT_STATE=$?
npm run test-bundle || EXIT_STATE=$?
npm run test-jasmine -- --skip-tags=gl,noCI || EXIT_STATE=$?
exit $EXIT_STATE
;;

jasmine2)
npm run test-jasmine -- --tags=gl --skip-tags=noCI || EXIT_STATE=$?
npm run test-bundle || EXIT_STATE=$?
exit $EXIT_STATE
;;

Expand All @@ -22,8 +27,8 @@ case $1 in
;;

syntax)
npm run lint || EXIT_STATE=$?
npm run test-syntax || EXIT_STATE=$?
npm run lint || EXIT_STATE=$?
npm run test-syntax || EXIT_STATE=$?
exit $EXIT_STATE
;;

Expand Down
18 changes: 14 additions & 4 deletions test/jasmine/karma.conf.js
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,10 @@ if(argv.info) {
' No need to add the `_test.js` suffix, we expand them correctly here.',
' - `--bundleTest` set the bundle test suite `test/jasmine/bundle_tests/ to be run.',
' Note that only one bundle test can be run at a time.',
' - Use `--tags` to specify which `@` tags to test (if any) e.g `npm run test-jasmine -- --tags=gl`',
' will run only gl tests.',
' - Use `--skip-tags` to specify which `@` tags to skip (if any) e.g `npm run test-jasmine -- --skip-tags=gl`',
' will skip all gl tests.',
'',
'Other options:',
' - `--info`: show this info message',
Expand Down Expand Up @@ -101,9 +105,7 @@ var pathToJQuery = path.join(__dirname, 'assets', 'jquery-1.8.3.min.js');
var pathToIE9mock = path.join(__dirname, 'assets', 'ie9_mock.js');
var pathToCustomMatchers = path.join(__dirname, 'assets', 'custom_matchers.js');


function func(config) {

// level of logging
// possible values: config.LOG_DISABLE || config.LOG_ERROR || config.LOG_WARN || config.LOG_INFO || config.LOG_DEBUG
//
Expand Down Expand Up @@ -202,9 +204,17 @@ func.defaultConfig = {
debug: true
},

// unfortunately a few tests don't behave well on CI
// using `karma-jasmine-spec-tags`
// Options for `karma-jasmine-spec-tags`
// see https://www.npmjs.com/package/karma-jasmine-spec-tags
//
// A few tests don't behave well on CI
// add @noCI to the spec description to skip a spec on CI
//
// Label tests that require a WebGL-context by @gl so that
// they can be skipped using:
// - $ npm run test-jasmine -- --skip-tags=gl
// or run is isolation easily using:
// - $ npm run test-jasmine -- --tags=gl
client: {
tagPrefix: '@',
skipTags: isCI ? 'noCI' : null
Expand Down
2 changes: 1 addition & 1 deletion test/jasmine/tests/geo_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -1072,7 +1072,7 @@ describe('Test geo interactions', function() {
.then(done);
});

it('@noCI should clear hover label when cursor slips off subplot', function(done) {
it('should clear hover label when cursor slips off subplot', function(done) {
var gd = createGraphDiv();
var fig = Lib.extendDeep({}, require('@mocks/geo_orthographic.json'));

Expand Down
4 changes: 2 additions & 2 deletions test/jasmine/tests/gl2d_click_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ var mock4 = {
layout: {}
};

describe('Test hover and click interactions', function() {
describe('@gl Test hover and click interactions', function() {
var gd;

function makeHoverFn(gd, x, y) {
Expand Down Expand Up @@ -532,7 +532,7 @@ describe('Test hover and click interactions', function() {
});
});

describe('@noCI Test gl2d lasso/select:', function() {
describe('@noCI @gl Test gl2d lasso/select:', function() {
var mockFancy = require('@mocks/gl2d_14.json');
var mockFast = Lib.extendDeep({}, mockFancy, {
data: [{mode: 'markers'}],
Expand Down
2 changes: 1 addition & 1 deletion test/jasmine/tests/gl2d_date_axis_render_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ var Plotly = require('@lib');
var createGraphDiv = require('../assets/create_graph_div');
var destroyGraphDiv = require('../assets/destroy_graph_div');

describe('date axis', function() {
describe('@gl date axis', function() {

var gd;

Expand Down
6 changes: 3 additions & 3 deletions test/jasmine/tests/gl2d_plot_interact_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ function countCanvases() {
return d3.selectAll('canvas').size();
}

describe('Test removal of gl contexts', function() {
describe('@gl Test removal of gl contexts', function() {
var gd;

beforeEach(function() {
Expand Down Expand Up @@ -85,7 +85,7 @@ describe('Test removal of gl contexts', function() {
});
});

describe('Test gl plot side effects', function() {
describe('@gl Test gl plot side effects', function() {
var gd;

beforeEach(function() {
Expand Down Expand Up @@ -205,7 +205,7 @@ describe('Test gl plot side effects', function() {
});
});

describe('Test gl2d plots', function() {
describe('@gl Test gl2d plots', function() {
var gd;

var mock = require('@mocks/gl2d_10.json');
Expand Down
2 changes: 1 addition & 1 deletion test/jasmine/tests/gl2d_pointcloud_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ function makePlot(gd, mock, done) {
.then(done);
}

describe('contourgl plots', function() {
describe('@gl pointcloud traces', function() {

var gd;

Expand Down
2 changes: 1 addition & 1 deletion test/jasmine/tests/gl2d_scatterplot_contour_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -167,7 +167,7 @@ function makePlot(gd, mock, done) {
.then(done);
}

describe('contourgl plots', function() {
describe('@gl contourgl plots', function() {

var gd;

Expand Down
12 changes: 6 additions & 6 deletions test/jasmine/tests/gl3d_plot_interact_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ function countCanvases() {
return d3.selectAll('canvas').size();
}

describe('Test gl3d plots', function() {
describe('@gl Test gl3d plots', function() {
var gd, ptData;

var mock = require('@mocks/gl3d_marker-arrays.json');
Expand Down Expand Up @@ -422,7 +422,7 @@ describe('Test gl3d plots', function() {

});

describe('Test gl3d modebar handlers', function() {
describe('@gl Test gl3d modebar handlers', function() {
var gd, modeBar;

function assertScenes(cont, attr, val) {
Expand Down Expand Up @@ -650,7 +650,7 @@ describe('Test gl3d modebar handlers', function() {
});
});

describe('Test gl3d drag and wheel interactions', function() {
describe('@gl Test gl3d drag and wheel interactions', function() {
var gd, relayoutCallback;

function scroll(target) {
Expand Down Expand Up @@ -768,7 +768,7 @@ describe('Test gl3d drag and wheel interactions', function() {
});
});

describe('Test gl3d relayout calls', function() {
describe('@gl Test gl3d relayout calls', function() {
var gd;

beforeEach(function() {
Expand Down Expand Up @@ -834,7 +834,7 @@ describe('Test gl3d relayout calls', function() {
});
});

describe('Test gl3d annotations', function() {
describe('@gl Test gl3d annotations', function() {
var gd;

beforeEach(function() {
Expand Down Expand Up @@ -1212,7 +1212,7 @@ describe('Test gl3d annotations', function() {
});
});

describe('Test removal of gl contexts', function() {
describe('@gl Test removal of gl contexts', function() {
var gd;

beforeEach(function() {
Expand Down
2 changes: 1 addition & 1 deletion test/jasmine/tests/gl_plot_interact_basic_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ function testEvents(plot) {
});
}

describe('gl3d plots', function() {
describe('@gl gl3d plots', function() {

var gd;

Expand Down
8 changes: 4 additions & 4 deletions test/jasmine/tests/parcoords_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,7 @@ describe('parcoords initialization tests', function() {
});
});

describe('@noCI parcoords', function() {
describe('@gl parcoords', function() {

beforeAll(function() {
mock.data[0].dimensions.forEach(function(d) {
Expand Down Expand Up @@ -404,7 +404,7 @@ describe('@noCI parcoords', function() {
});
});

it('Works with 60 dimensions', function(done) {
it('@noCI Works with 60 dimensions', function(done) {

var mockCopy = Lib.extendDeep({}, mock1);
var newDimension, i, j;
Expand Down Expand Up @@ -434,7 +434,7 @@ describe('@noCI parcoords', function() {
});
});

it('Truncates 60+ dimensions to 60', function(done) {
it('@noCI Truncates 60+ dimensions to 60', function(done) {

var mockCopy = Lib.extendDeep({}, mock1);
var newDimension, i, j;
Expand Down Expand Up @@ -462,7 +462,7 @@ describe('@noCI parcoords', function() {
});
});

it('Truncates dimension values to the shortest array, retaining only 3 lines', function(done) {
it('@noCI Truncates dimension values to the shortest array, retaining only 3 lines', function(done) {

var mockCopy = Lib.extendDeep({}, mock1);
var newDimension, i, j;
Expand Down
6 changes: 3 additions & 3 deletions test/jasmine/tests/polar_test.js
Original file line number Diff line number Diff line change
Expand Up @@ -702,7 +702,7 @@ describe('Test polar interactions:', function() {
.then(done);
});

it('@noCI should response to drag interactions on plot area', function(done) {
it('should response to drag interactions on plot area', function(done) {
var fig = Lib.extendDeep({}, require('@mocks/polar_scatter.json'));

// to avoid dragging on hover labels
Expand Down Expand Up @@ -793,7 +793,7 @@ describe('Test polar interactions:', function() {
.then(done);
});

it('@noCI should response to drag interactions on radial drag area', function(done) {
it('should response to drag interactions on radial drag area', function(done) {
var fig = Lib.extendDeep({}, require('@mocks/polar_scatter.json'));

// to avoid dragging on hover labels
Expand Down Expand Up @@ -877,7 +877,7 @@ describe('Test polar interactions:', function() {
.then(done);
});

it('@noCI should response to drag interactions on angular drag area', function(done) {
it('should response to drag interactions on angular drag area', function(done) {
var fig = Lib.extendDeep({}, require('@mocks/polar_scatter.json'));

// to avoid dragging on hover labels
Expand Down