Make WordPress Core

Opened 5 weeks ago

Closed 3 weeks ago

Last modified 3 weeks ago

#62808 closed defect (bug) (fixed)

Puppeteer tests in old branches failing

Reported by: desrosj's profile desrosj Owned by:
Milestone: 6.7.2 Priority: normal
Severity: normal Version:
Component: Build/Test Tools Keywords: has-patch
Focuses: Cc:

Description

Puppeteer-based tests in older branches have started failing recently. This seems to be related to the ubuntu-latest alias being updated to use ubuntu-24 instead of ubuntu-22.

Change History (31)

This ticket was mentioned in PR #8128 on WordPress/wordpress-develop by @desrosj.


5 weeks ago
#1

  • Keywords has-patch added; needs-patch removed

#4 @desrosj
5 weeks ago

This is confirmed to be happening as a result of the ubuntu-24 upgrade.

It seems that some level of updating Puppeteer/Qunit will fix the issue in the 6.0 branch. However, this would require a handful of other compatibility backports for the older branches as well. Those are also hamstrung by the fact that these older branches run Node.js 14.x.

Either update route is not ideal.

@swissspidy shared that he recently fixed this with a GitHub Actions step. I've spot tested that in a few branches, and it fixes the tests for the 4.1, 5.4, and 6.0 branches. The attached PR to trunk adds an input to the workflow and only runs that new step if true is passed.

@desrosj commented on PR #8127:


5 weeks ago
#5

Adjusted the input name and added some additional docs about the purpose of the new step.

#6 @desrosj
5 weeks ago

In 59635:

Build/Test Tools: Add input for disabling AppArmor.

Old branches requiring outdated versions of Chromium to run JavaScript tests have recently started failing as a result of the ubuntu-latest container being updated to point to ubuntu-24.

This introduces a new input to the reusable JavaScript testing workflow to allow a fix to be used without having to update Chromium or tests in these branches.

Props swissspidy.
See #62808.

#8 @desrosj
5 weeks ago

In 59636:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24.

Props swissspidy, mukesh27.
See #62808.

#9 @desrosj
5 weeks ago

In 59637:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.9 branch.

Props swissspidy, mukesh27.
See #62808.

#10 @desrosj
5 weeks ago

In 59638:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.8 branch.

Props swissspidy, mukesh27.
See #62808.

#11 @desrosj
5 weeks ago

In 59639:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.7 branch.

Props swissspidy, mukesh27.
See #62808.

#12 @desrosj
5 weeks ago

In 59640:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.6 branch.

Props swissspidy, mukesh27.
See #62808.

#13 @desrosj
5 weeks ago

In 59641:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.5 branch.

Props swissspidy, mukesh27.
See #62808.

#14 @desrosj
5 weeks ago

In 59642:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.4 branch.

Props swissspidy, mukesh27.
See #62808.

#15 @desrosj
5 weeks ago

In 59643:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.3 branch.

Props swissspidy, mukesh27.
See #62808.

#16 @desrosj
5 weeks ago

In 59644:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.2 branch.

Props swissspidy, mukesh27.
See #62808.

#17 @desrosj
5 weeks ago

In 59645:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.1 branch.

Props swissspidy, mukesh27.
See #62808.

#18 @desrosj
5 weeks ago

In 59646:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 5.0 branch.

Props swissspidy, mukesh27.
See #62808.

#19 @desrosj
5 weeks ago

In 59647:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.9 branch.

Props swissspidy, mukesh27.
See #62808.

#20 @desrosj
5 weeks ago

In 59648:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.8 branch.

Props swissspidy, mukesh27.
See #62808.

#21 @desrosj
5 weeks ago

In 59649:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.7 branch.

Props swissspidy, mukesh27.
See #62808.

#22 @desrosj
5 weeks ago

In 59650:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.6 branch.

Props swissspidy, mukesh27.
See #62808.

#23 @desrosj
5 weeks ago

In 59651:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.5 branch.

Props swissspidy, mukesh27.
See #62808.

#24 @desrosj
5 weeks ago

In 59652:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.4 branch.

Props swissspidy, mukesh27.
See #62808.

#25 @desrosj
5 weeks ago

In 59653:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.3 branch.

Props swissspidy, mukesh27.
See #62808.

#26 @desrosj
5 weeks ago

In 59654:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.2 branch.

Props swissspidy, mukesh27.
See #62808.

#27 @desrosj
5 weeks ago

In 59655:

Build/Test Tools: Disable AppArmor for JavaScript testing.

This makes use of the new input added in [59635] that fixes tests on ubuntu-24 in the 4.1 branch.

Props swissspidy, mukesh27.
See #62808.

#30 @desrosj
3 weeks ago

  • Milestone changed from 6.8 to 6.7.2
  • Resolution set to fixed
  • Status changed from new to closed

#31 @desrosj
3 weeks ago

In 59720:

Build/Test Tools: Avoid using *-latest tags for runner images.

While using the ubuntu-latest, macos-latest, and windows-latest runner image tags is convenient, it has proven to be problematic in a number of instances as the runners are slowly updated (see #62808 and #62843).

This switches all workflows to using specific version tags representing the latest non-preview versions, which currently are as follows:

  • ubuntu-24.04
  • windows-2022
  • macos-14

Props swissspidy, johnbillion.
See #62221.

Note: See TracTickets for help on using tickets.