Only run and upload one test run to Codecov

[johnbillion]

In the Code Coverage Report workflow, the test suite is run once for single site and once for Multisite and both results are uploaded to Codecov. It appears that Codecov only provides graphs for one upload from each commit, and it appears that the most recent is used, which means only the Multisite report is used as it runs second. Example: ​https://codecov.io/gh/WordPress/wordpress-develop/tree/f400eb5ab9e80f62939bd8630e27e08ee0619ba1/src

This means the single site test run in this workflow is useless.

Let's remove either the single site test run or the Multisite test run to avoid CPU and speed up this workflow.

My opinion is we should stick with the Multisite test run so we have coverage reports for Multisite files too.

[desrosj]

This makes sense, and using the Multisite report sounds good.

[swissspidy]

Would Codecov‘s flag feature help here?

I remember discussing this before in another ticket.

​https://docs.codecov.io/docs/flags

[jorbin]

We are using the flags and they are working as expected though the UI in codecov could lead to some confusion here. I'll use wp_lostpassword_url as an example for why I think things are working as expected.

By default, all three flags are checked and we can see that line 624 is covered:

If only single is selected, then 624 is not covered, but 627 remains covered:

If only multisite is selected, then 624 is still covered, but 627 is not.

The reason there are three flags is so that when we add E2E tests, we can see what is covered by php tests and what is covered by e2e tests. I don't know why there is a 2 in the sidebar when 3 flags should have a line covered.

[johnbillion]

Thanks for that info @jorbin! I hadn't seen the flags on the single file views because I was looking at the Coverage numbers on the directory listing view where unfortunately those filters aren't available.

This does indeed seem to be working as expected even if the UI is not completely clear.

I'll close this off.