WordPress.org

Make WordPress Core

Opened 7 months ago

Closed 6 months ago

Last modified 6 months ago

#40407 closed task (blessed) (fixed)

Trim the test matrix on Travis for older branches

Reported by: johnbillion Owned by:
Milestone: 4.8 Priority: normal
Severity: normal Version: 3.8
Component: Build/Test Tools Keywords:
Focuses: Cc:

Description

During patch releases (eg. security and maintenance releases), the time that it takes for the Travis builds to run is a substantial hindrance to shipping and backporting quickly.

Given that backports go to 11 branches now, and each branch takes ~20 minutes to test on Travis, that's around 3.5 hours to wait before releasing, and that's not including all the time wasted cancelling builds on branches with multiple commits.

It's time we trimmed down the test matrix on older branches to remove the PHP 5.3, 5.4, 5.5, hhvm, nightly, and non-latest-7.x jobs from the branch builds. That leaves the JS job, and the 5.2, 5.6, 5.6 memcached, and latest 7.x.

The likelihood of a patch release breaking on a version of PHP between 5.3 and 5.5 but not affecting 5.2 or 5.6+ is very low. The risk is greatly outweighed by the benefit of faster and less stressful builds.

Change History (13)

#1 follow-up: @desrosj
7 months ago

I noticed this week that Travis has a new setting for automatically cancelling builds as mentioned above. Enabling those new settings (even as a beta feature) may also help alleviate some of the stress of the manual cancellations.

https://cloudup.com/coG_h0ohZ2N+

Last edited 7 months ago by desrosj (previous) (diff)

#2 @johnbillion
7 months ago

In 40407:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.1 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#3 @johnbillion
7 months ago

In 40408:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.2 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#4 @johnbillion
7 months ago

In 40409:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.3 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#5 @johnbillion
7 months ago

In 40410:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.4 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#6 @johnbillion
7 months ago

In 40411:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.5 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#7 @johnbillion
7 months ago

In 40412:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.6 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#8 @johnbillion
7 months ago

In 40413:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.0 branch build.

This removes all allowed failure jobs, plus PHP 5.3 and 5.4 jobs.

See #40407

#9 @johnbillion
7 months ago

In 40414:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 3.9 branch build.

This removes the PHP 5.3 and 5.4 jobs.

See #40407

#10 @johnbillion
7 months ago

In 40415:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 3.8 branch build.

This removes the PHP 5.3 and 5.4 jobs.

See #40407

#11 in reply to: ↑ 1 @johnbillion
7 months ago

Replying to desrosj:

I noticed this week that Travis has a new setting for automatically cancelling builds as mentioned above. Enabling those new settings (even as a beta feature) may also help alleviate some of the stress of the manual cancellations.

Yeah I think that will help a good deal, too. We enabled it a few weeks ago: #38500.

#12 @johnbillion
6 months ago

  • Resolution set to fixed
  • Status changed from new to closed

This ticket was mentioned in Slack in #core-multisite by flixos90. View the logs.


6 months ago

Note: See TracTickets for help on using tickets.