Make WordPress Core

Opened 9 months ago

Closed 7 months ago

#63038 closed defect (bug) (wontfix)

Performance Tests: "before" checks fail on older PRs

Reported by: joemcgill's profile joemcgill Owned by:
Milestone: Priority: normal
Severity: normal Version:
Component: Build/Test Tools Keywords:
Focuses: performance Cc:

Description

The Performance workflow includes a job for testing the performance of the previous commit in order to show the performance impact of the change compared to the latest commit prior to the change.

This can fail on the "Download previous build artifact (target branch or previous commit)" step if the PR is old enough that the Artifact has expired.

Ideally, PRs should test trunk against the current PR when applied to trunk, but if that is not easily possible, the tests should be able to create a new build from the prior state whenever the build artifact has expired.

These were recently changed in [59749] which may be where this issue was introduced.

Change History (4)

#1 @swissspidy
9 months ago

Wouldn't be easier to just merge trunk into the branches to make them up-to-date again?

#2 @johnbillion
8 months ago

This affects any PR with a base branch that is more than 90 days old, which is the retention period for artifacts. We could add support for re-generating the build in this situation, but I also agree with @swissspidy that a PR with a base that's more than 90 days old should be rebased or have trunk merged into it regardless. This would be nice to fix but I don't think it's strictly necessary.

#3 @desrosj
8 months ago

  • Keywords close added
  • Milestone changed from 6.8 to Awaiting Review

Although this is a CI related change, I'm going to punt it for now with a close suggestion. I do agree with the sentiment around merging trunk into the branch after the 90 day artifact lifespan. It's a nice reminder to update your branch if someone has forgotten to.

#4 @flixos90
7 months ago

  • Keywords close removed
  • Milestone Awaiting Review deleted
  • Resolution set to wontfix
  • Status changed from new to closed

Based on the previous feedback, I'm going to close this. Given the ability and best practice to refresh a PR with latest trunk, I don't think it's worth the effort.

Note: See TracTickets for help on using tickets.