Make WordPress Core

Opened 8 years ago

Closed 8 years ago

Last modified 5 years ago

#40407 closed task (blessed) (fixed)

Trim the test matrix on Travis for older branches

Reported by: johnbillion's profile johnbillion Owned by:
Milestone: 4.8 Priority: normal
Severity: normal Version: 3.8
Component: Build/Test Tools Keywords:
Focuses: Cc:

Description

During patch releases (eg. security and maintenance releases), the time that it takes for the Travis builds to run is a substantial hindrance to shipping and backporting quickly.

Given that backports go to 11 branches now, and each branch takes ~20 minutes to test on Travis, that's around 3.5 hours to wait before releasing, and that's not including all the time wasted cancelling builds on branches with multiple commits.

It's time we trimmed down the test matrix on older branches to remove the PHP 5.3, 5.4, 5.5, hhvm, nightly, and non-latest-7.x jobs from the branch builds. That leaves the JS job, and the 5.2, 5.6, 5.6 memcached, and latest 7.x.

The likelihood of a patch release breaking on a version of PHP between 5.3 and 5.5 but not affecting 5.2 or 5.6+ is very low. The risk is greatly outweighed by the benefit of faster and less stressful builds.

Change History (19)

#1 follow-up: @desrosj
8 years ago

I noticed this week that Travis has a new setting for automatically cancelling builds as mentioned above. Enabling those new settings (even as a beta feature) may also help alleviate some of the stress of the manual cancellations.

https://cloudup.com/coG_h0ohZ2N

Version 0, edited 8 years ago by desrosj (next)

#2 @johnbillion
8 years ago

In 40407:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.1 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#3 @johnbillion
8 years ago

In 40408:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.2 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#4 @johnbillion
8 years ago

In 40409:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.3 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#5 @johnbillion
8 years ago

In 40410:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.4 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#6 @johnbillion
8 years ago

In 40411:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.5 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#7 @johnbillion
8 years ago

In 40412:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.6 branch build.

This removes all allowed failure jobs, plus PHP 5.3, 5.4, and 5.5 jobs.

See #40407

#8 @johnbillion
8 years ago

In 40413:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.0 branch build.

This removes all allowed failure jobs, plus PHP 5.3 and 5.4 jobs.

See #40407

#9 @johnbillion
8 years ago

In 40414:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 3.9 branch build.

This removes the PHP 5.3 and 5.4 jobs.

See #40407

#10 @johnbillion
8 years ago

In 40415:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 3.8 branch build.

This removes the PHP 5.3 and 5.4 jobs.

See #40407

#11 in reply to: ↑ 1 @johnbillion
8 years ago

Replying to desrosj:

I noticed this week that Travis has a new setting for automatically cancelling builds as mentioned above. Enabling those new settings (even as a beta feature) may also help alleviate some of the stress of the manual cancellations.

Yeah I think that will help a good deal, too. We enabled it a few weeks ago: #38500.

#12 @johnbillion
8 years ago

  • Resolution set to fixed
  • Status changed from new to closed

This ticket was mentioned in Slack in #core-multisite by flixos90. View the logs.


8 years ago

#14 @johnbillion
6 years ago

In 44991:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 4.9 branch build.

This removes the PHP 7.1, 7.0, 5.5, 5.4, 5.3, and nightly jobs.

See #42387, #40407

#15 @johnbillion
6 years ago

In 44992:

Build/Test tools: Trim the test matrix on Travis in order to speed up the 5.0 branch build.

This removes the PHP 7.2, 7.1, 7.0, 5.5, 5.4, 5.3, and nightly jobs.

See #42387, #40407

#16 @SergeyBiryukov
5 years ago

In 47322:

Build/Test Tools: Trim the test matrix on Travis in order to speed up the 5.1 branch build.

This removes the PHP 7.2, 7.1, 5.5, 5.4, and 5.3 jobs.

This also removes the PHP 5.6 job which runs without an object cache in place as the likelihood of a change being backported that only breaks 5.6 environments without an object cache is small.

Merges [44992] and [45005] to the 5.1 branch.
See #42387, #40407.

#17 @SergeyBiryukov
5 years ago

In 47323:

Build/Test Tools: Move the PHP 7.3 Travis job in 5.0 branch after the JS tests, for consistency with other branches.

See #42387, #40407.

#18 @desrosj
5 years ago

#48413 was marked as a duplicate.

#19 @desrosj
5 years ago

In 47928:

Build/Test Tools: Trim the test matrix on Travis in order to speed up the 5.2 branch build.

This removes the PHP 7.2 and 7.1 jobs.

This also removes the PHP 7.3 job which runs without an object cache in place as the likelihood of a change being backported that only breaks 7.3 without an object cache is small.

See #42387, #40407.

Note: See TracTickets for help on using tickets.