Add PHPUnit setup to composer.json

[welcher]

Setting up the correct version of PHPUnit to run tests locally can be difficult and confusing. It is also different depending on what is being used as the web server ( MAMP, VVV, etc ). This can be simplified to some extent by leveraging composer to install the correct, compatible PHPUnit version and provide a script to run the tests.

The attached patch adds PHPunit as a dev dependency and introduces a unit-tests composer command.

[welcher]

Initial patch

[johnbillion]

I'd love to do this, but the problem it introduces is that the CI tests on older versions of PHP won't be able to install PHPUnit 7 as the PHP requirements won't be met.

It might be possible to use the config.platform.php setting in composer.json to set the PHP version to 7.3, and then allow the existing PHPUnit installation in .travis.yml to do its thing.

[johnbillion]

Ref: ​https://github.com/WordPress/wordpress-develop/blob/075a85c05e7c304cf131fa3262670e7abe3e9606/.travis.yml#L61-L82

[welcher]

@johnbillion as per our slack chat. It looks like composer install is only being run for 7.2 which is compatible with PHPUnit 7. Are their any other concerns?

[welcher]

@johnbillion Travis on my branch is passing - ​https://travis-ci.org/ryanwelcher/wordpress-develop/builds/516295436

[johnbillion]

We'll need to consider the impact on projects that specify WordPress as a dependency via one of the unofficial packages, eg johnpbloch/wordpress, roots/wordpress, or wordplate/wordplate, but use a version of PHPUnit less than 7.

CCing a few people for their feedback: @rarst @austinpray @johnpbloch @vinkla

[johnbillion]

"phpunit/phpunit": "<8" could work.

[vinkla]

Specify version ^5.0 || ^6.0 || ^7.0 || ^8.0 for phpunit/phpunit and Composer will figure out which version to use.

[Rarst]

require-dev is root–only, it’s not processed for dependencies so it can't conflict.

[ayeshrajans]

I always wondered why we don't use the composer.json file to install PHPUnit, but have a complex switch/case matrix in .travis.yml with composer install phpunit/phpunit calls.

• Because we use different phpunit versions for each PHP version, we cannot use the same composer.lock file. When composer install is run, composer will install the exact list of packages regardless of the platform PHP version. As a solution, we can remove shipping our composer.lock file. PHPUnit promptly follows server, and we shouldn't be afraid of minor updates.

• With the .travis.yml, PHPUnit is installed globally. If we were to regular composer require-dev, we will now need to update all PHPUnit invocations to use the vendor/bin/phpunit path because IIRC, Travis images already have PHPUnit installed.

• This will require us to update the Gruntfile.js to use the new vendor/bin/phpunit executable instead of the global one.

I understand why whoever decided to use composer install in the Travis to install phpunit, but with WordPress dropping PHP 5.2 (so we will always have composer)` I think it's a good time to finally clean up and fix.

[ayeshrajans]

I have made a more elaborate list of changes (​https://github.com/Ayesh/wordpress-develop/commits/composer-phpunit), and tests pass (​https://travis-ci.org/Ayesh/wordpress-develop/builds/516626733 , save for some formatting issues in a build job).

[vinkla]

Out of curiosity; is there any reason why PHPUnit 8.0 is excluded?

[ayeshrajans]

Replying to vinkla:

Out of curiosity; is there any reason why PHPUnit 8.0 is excluded?

PHPUnit 8 requires PHP versions 7.2 or higher. Class methid signatures are not compatible with the tests we currently have (lack of void return types for example), so we can't use PHPUnit 8 yet.

[welcher]

@ayeshrajans thanks for the thoughtful and thorough patch.

I am wondering if we should split it out into a separate ticket that is focused on the Travis changes/conversation so we don't risk turning this ticket into an epic.

@johnbillion any objections?

[welcher]

@johnbillion I've uploaded a new patch refreshed against master and using the approach @vinkla mentioned

My Travis tests are passing: ​https://travis-ci.org/ryanwelcher/wordpress-develop/builds/525030607

Is there anything further I can add or test?

[netweb]

Replying to ayeshrajans:

... As a solution, we can remove shipping our composer.lock file.

A ticket for this has now been created:

Related: #47381 - Remove the Composer lock file from version control

[welcher]

Refreshed patch

[welcher]

@johnbillion @netweb patch refreshed. Hoping this can still get in 5.3

[netweb]

Replying to welcher:

@johnbillion @netweb patch refreshed. Hoping this can still get in 5.3

Thanks @welcher, your patch is a little off, it has a couple of of changes relating to WPCS, you've changed it from 2.1.0 to 2.0.0, and added it as a script, I suspect this is because of recent commits, would you mind refreshing 46815.3.diff​ please.

[welcher]

@netweb thanks for the feedback. I must have resolved merge conflicts badly at some point. My latest patch looks correct to me.

[desrosj]

I'm punting this to Future Release. When this is ready, it can be moved into a numbered milestone.

[ayeshrajans]

Also see #47767. PHPUnit setup is currently done at docker level unless I'm reading that ticket wrong.

[johnbillion]

I don't have time to look at this before beta so let's try again in 5.5 early.

[ocean90]

Let's give 46815.5.diff​ a try.

Trac ticket: https://core.trac.wordpress.org/ticket/46815

[ocean90]

In 47881:

Build/Test Tools: Add PHPUnit to Composer dev dependencies.

This helps setting up the correct version of PHPUnit to run WordPress core tests locally and for using it as source for code autocompletion in tests. Also introduces a new Composer script test to run the PHPUnit tests.

Props welcher, ayeshrajans, vinkla, johnbillion, Rarst, netweb, ocean90.
Fixes #46815.

[desrosj]

Going to include this in a Build/Test Tools & General PHP improvements dev note.

[desrosj]

Referenced in the following dev note: ​https://make.wordpress.org/core/2020/07/14/php-related-improvements-changes-wordpress-5-5-edition/.