Make WordPress Core

Opened 9 months ago

Closed 9 months ago

Last modified 6 months ago

#58779 closed defect (bug) (fixed)

Suppress E2E test suite slack notifications

Reported by: peterwilsoncc's profile peterwilsoncc Owned by: peterwilsoncc's profile peterwilsoncc
Milestone: 6.3 Priority: normal
Severity: normal Version:
Component: Build/Test Tools Keywords: has-patch
Focuses: Cc:

Description

The E2E test suite is currently flakey and resulting in a lot of noise in the #core Slack channel. Despite efforts to resolve the flakiness, the issue remains.

I propose to suppress the E2E test notifications in Slack until the issue can be resolved. This is to account for the human condition, the Slack notifications are being seen as busyness that can be ignored.

Change History (6)

#2 @peterwilsoncc
9 months ago

  • Owner set to peterwilsoncc
  • Resolution set to fixed
  • Status changed from new to closed

In 56198:

Build/Test Tools: Suppress E2E test suite Slack notifications.

Remove Slack notifications of E2E test suite failures while the tests are flakey to improve the signal-to-noise ratio.

Fixes #58779.

#4 @desrosj
9 months ago

In 56308:

Build/Test Tools: Restore automatically retrying failed E2E tests once.

This restores the GitHub Actions job responsible for automatically retrying a failed workflow once within the E2E testing workflow.

[56198] disabled Slack notifications for this workflow because of the increased number of timeout errors occurring after recent changes until they could be further investigated. Even though the signal-to-noise ration was way too high, there’s still benefit in retrying the workflow once to see if the timeout can be resolved without human intervention. The one retry attempt will not result in any Slack notifications.

Follow up to [56198].
See #58779.

#5 @desrosj
7 months ago

In 56539:

Build/Test Tools: Restore automatically retrying failed E2E tests once.

This restores the GitHub Actions job responsible for automatically retrying a failed workflow once within the E2E testing workflow.

[56198] disabled Slack notifications for this workflow because of the increased number of timeout errors occurring after recent changes until they could be further investigated. Even though the signal-to-noise ration was way too high, there’s still benefit in retrying the workflow once to see if the timeout can be resolved without human intervention. The one retry attempt will not result in any Slack notifications.

Follow up to [56198].
Merges [56308] to the 6.3 branch.
See #58779.

Note: See TracTickets for help on using tickets.