Context Navigation

← Previous Ticket
Next Ticket →

#52612 closed enhancement (fixed)

Disable fast failing on GitHub Actions

Reported by:	johnbillion	Owned by:	desrosj
Priority:	normal	Milestone:	5.8
Component:	Build/Test Tools	Version:
Severity:	normal	Keywords:
Cc:		Focuses:

Description

The fail-fast option is enabled by default on GitHub Actions. This means if a job fails, all other jobs that have not yet run get automatically cancelled.

This is good for being alerted sooner to a failure, but bad when you're trying to identify if a failure is specific to one job or all jobs because all other remaining jobs get cancelled.

I propose setting fail-fast to false in our config.

Ref: https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast

Change History (24)

#1 @jorbin
5 years ago

This sounds good to me. :shipit:

#2 @desrosj
5 years ago

Owner set to desrosj
Status new → accepted

#3 @desrosj
5 years ago

Resolution → fixed
Status accepted → closed

In 50435:

Build/Test Tools: Disable fail-fast for PHPUnit testing.

In GitHub Actions, there is a fail-fast option that will cancel all incomplete jobs within a workflow as soon as one failure is encountered. This defaults to true.

This is great for alerting you of a failure faster, but does not give you the full picture of what is failing. For example, it’s possible that there is a failing test on 2 versions of PHP, but not others. If fail-fast is enabled, it’s impossible to know this.

Even with fail-fast disabled, the workflow will still report a failure if one or more jobs produce a failing result.

Props johbillion, jorbin.
Fixes #52612.

#4 @desrosj
5 years ago

Keywords dev-feedback needs-patch removed
Milestone Awaiting Review → 5.8

#5 @desrosj
5 years ago

In 50602:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.6 branch.

This backports several build and test tool improvements to the 5.6 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
The ability to run PHPUnit tests from src instead of build [50441-50443].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50267,50299,50379,50387,50413,50416,50432,50435-50436,50441-50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50592,50598] to the 5.6 branch.
See #50401, #51734, #51801, #51802, #52548, #52608, #52612, #52623, #52624, #52625, #52645, #52653, #52658, #52660, #52667, #52786.

#6 @desrosj
5 years ago

In 50603:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.5 branch.

This backports several build and test tool improvements to the 5.5 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
The ability to run PHPUnit tests from src instead of build [50441-50443].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50267,50299,50379,50387,50413,50416,50432,50435-50436,50441-50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50592,50598] to the 5.5 branch.
See #50401, #51734, #51801, #51802, #52548, #52608, #52612, #52623, #52624, #52625, #52645, #52653, #52658, #52660, #52667, #52786.

#7 @desrosj
5 years ago

In 50604:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.4 branch.

This backports several build and test tool improvements to the 5.4 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
The ability to run PHPUnit tests from src instead of build [50441-50443].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50267,50299,50379,50387,50413,50416,50432,50435-50436,50441-50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50598] to the 5.4 branch.
See #50401, #51734, #51801, #51802, #52548, #52608, #52612, #52623, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#8 @desrosj
5 years ago

In 50605:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.3 branch.

This backports several build and test tool improvements to the 5.3 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
The ability to run PHPUnit tests from src instead of build [50441-50443].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50267,50299,50379,50387,50413,50416,50432,50435-50436,50441-50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50598] to the 5.3 branch.
See #50401, #51734, #51801, #51802, #52548, #52608, #52612, #52623, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#9 @desrosj
5 years ago

In 50606:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.2 branch.

This backports several build and test tool improvements to the 5.2 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
The ability to run PHPUnit tests from src instead of build [50441-50443].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50267,50299,50379,50387,50413,50416,50432,50435-50436,50441-50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50598] to the 5.2 branch.
See #50401, #51734, #51801, #51802, #52548, #52608, #52612, #52623, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#10 @desrosj
5 years ago

In 50622:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.1 branch.

This backports several build and test tool improvements to the 5.1 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [45317,50267,50379,50387,50413,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50598] to the 5.1 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#11 @desrosj
5 years ago

In 50624:

Build/Test Tools: Backport GitHub Action and build improvements to the 5.0 branch.

This backports several build and test tool improvements to the 5.0 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [45317,50267,50379,50387,50413,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50579,50590,50598] to the 5.0 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#12 @desrosj
5 years ago

In 50625:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.9 branch.

This backports several build and test tool improvements to the 4.9 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50413,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.9 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#13 @desrosj
5 years ago

In 50626:

Build/Test Tools: Backport GitHub Action and build improvements to the 3.7 branch.

This backports several build and test tool improvements to the 3.7 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50413,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 3.7 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#14 @desrosj
5 years ago

In 50635:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.8 branch.

This backports several build and test tool improvements to the 4.8 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50413,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.8 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#15 @desrosj
5 years ago

In 50636:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.7 branch.

This backports several build and test tool improvements to the 4.7 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50413,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.7 branch.
See #50401, #51801, #51802, #52548, #52608, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#16 @desrosj
5 years ago

In 50637:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.6 branch.

This backports several build and test tool improvements to the 4.6 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.6 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#17 @desrosj
5 years ago

In 50638:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.5 branch.

This backports several build and test tool improvements to the 4.5 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.5 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#18 @desrosj
5 years ago

In 50639:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.4 branch.

This backports several build and test tool improvements to the 4.4 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.4 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#19 @desrosj
5 years ago

In 50640:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.3 branch.

This backports several build and test tool improvements to the 4.3 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.3 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#20 @desrosj
5 years ago

In 50642:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.2 branch.

This backports several build and test tool improvements to the 4.2 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435,50436,50444,50446,50473,50474,50476,50479,50485,50486,50487,50545,50579,50590] to the 4.2 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#21 @desrosj
5 years ago

In 50643:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.1 branch.

This backports several build and test tool improvements to the 4.1 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50590] to the 4.1 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#22 @desrosj
5 years ago

In 50644:

Build/Test Tools: Backport GitHub Action and build improvements to the 4.0 branch.

This backports several build and test tool improvements to the 4.0 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50590] to the 4.0 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#23 @desrosj
5 years ago

In 50645:

Build/Test Tools: Backport GitHub Action and build improvements to the 3.9 branch.

This backports several build and test tool improvements to the 3.9 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50590] to the 3.9 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

#24 @desrosj
5 years ago

In 50646:

Build/Test Tools: Backport GitHub Action and build improvements to the 3.8 branch.

This backports several build and test tool improvements to the 3.8 branch. Most notably, this includes:

The changes required to allow each workflow to be triggered by the workflow_dispatch event so that tests can be run on a schedule [50590].
Splitting single site and multisite tests into parallel jobs [50379].
Split slow tests into separate, parallel jobs for PHP <= 5.6 [50444].
Better branch and path scoping for GitHub Action workflows when running on pull_request [50432,50479].
Several devDependency updates.

Merges [50379,50387,50416,50432,50435-50436,50444,50446,50473-50474,50476,50479,50485-50487,50545,50590] to the 3.8 branch.
See #50401, #51801, #51802, #52548, #52612, #52624, #52625, #52645, #52653, #52658, #52660, #52667.

Note: See TracTickets for help on using tickets.

Download in other formats:

Make WordPress Core

Context Navigation

#52612 closed enhancement (fixed)

Disable fast failing on GitHub Actions

Description

Change History (24)

#1 @jorbin 5 years ago

#2 @desrosj 5 years ago

#3 @desrosj 5 years ago

#4 @desrosj 5 years ago

#5 @desrosj 5 years ago

#6 @desrosj 5 years ago

#7 @desrosj 5 years ago

#8 @desrosj 5 years ago

#9 @desrosj 5 years ago

#10 @desrosj 5 years ago

#11 @desrosj 5 years ago

#12 @desrosj 5 years ago

#13 @desrosj 5 years ago

#14 @desrosj 5 years ago

#15 @desrosj 5 years ago

#16 @desrosj 5 years ago

#17 @desrosj 5 years ago

#18 @desrosj 5 years ago

#19 @desrosj 5 years ago

#20 @desrosj 5 years ago

#21 @desrosj 5 years ago

#22 @desrosj 5 years ago

#23 @desrosj 5 years ago

#24 @desrosj 5 years ago