tags (keywords) with umlauts don't get saved in german locale

[spielautomat4]

This report is about assigning keywords to an article.

First keyword: "Gärten" with slug "gaerten" (exists already)

Second keyword: "Garten" with slug "garten" (was not created yet)

I tried to apply the new keyword "Garten", but once I saved the article, the keyword "Gärten" was assigned in the preview. I removed it and tried to assign "Garten" once again, but WordPress keeps applying "Gärten" to the article, even though the editor showed "Garten" in the sidebar (as expected).

I then created the keyword "Garten" with slug "garten" manually in the keyword management interface. Now I have both keywords in my database.

But still, when I try to assign "Gärten" in the editor, WordPress keeps changing it to "Garten", once the article is saved and I view the preview. The slugs are different (gaerten vs. garten), but it seems like the editor confuses the German umlauts in Gärten with Garten.

I am using the latest WordPress 5.7.2 and the Classic Editor.

[spielautomat4]

Keyword in editor sidebar and article preview

[spielautomat4]

Sorry, mixed up the last paragraph. Should have been:

But still, when I try to assign "Garten" in the editor, WordPress keeps changing it to "Gärten"...

[spielautomat4]

BTW: "Garten" is the singular form of "Gärten", so these are two different terms.

[Presskopp]

Bug confirmed (5.8-RC4-51447, de_DE)

To reproduce I added the tag "Garten" and slug "garten" was created (using de_DE locale). Attached this tag to a post. So far so good. Then I tried to add a new tag "Gärten" and it was shown in tag list but after publishing the post it got lost. Deleted tag "garten" so only "gaerten" remained. But after updating the post it went back to slug "garten". See attached video.

[Presskopp]

related #53684

[audrasjb]

Looks good to me using a de_DE installation

[audrasjb]

I can't reproduce the issue on my side, using a de_DE installation.
Please make sure you really switched languages to de_DE on Settings > General settings.

[audrasjb]

Update: I think I reproduced part of the issue.

• using the block editor and a de_DE installation
• create a new post tagged gärten + garten (both tags should be created on the fly)
• publish the post
• go to Posts > Tags. Result : only gärten is created, with gaerten as a slug. The other tag is not created.

Video recording: ​https://i.gyazo.com/e8d361911748bf2ed15ab2987ad0153c.mp4

[spielautomat4]

@Presskopp: Yep, 53682#comment:3 is how you can reproduce the bug.

@audrasjb: Looks the same as 53682#comment:6 for me, but that's not the issue. WordPress does actually create both keywords with different slugs. Editor acts as expected as well. But once I save the post, the German umlauts get replaced by their dot-less equivalents.

Both, the language on Settings > General and in my profile are set to "Deutsch" (de_DE).

Neither do I use any additional plug-ins, besides the Classic Editor.

[spielautomat4]

Current language setting (de_DE)

[Presskopp]

related #53756

[spielautomat4]

This ticket is still awaiting review. Is there anything else I can provide to get this issue fixed?

Unfortunately, I'm not that familiar with WordPress core to fix the bug myself.

[costdev]

Testing Report 1 of 2 (Block Editor)

TL;DR

• Gärten is created with the gaerten slug.
• Garten is created with the garten slug.
• No issue to report.

Env

• WordPress: 5.8
• PHP: 7.4.18
• Localhost: WSL2 with Ubuntu 18.04
• OS: Windows 10
• Browser: Chrome 93.0.4577.82
• Theme: Twenty Twenty-One
• Plugins: None activated
• Custom scripts: none

Steps to Test

1. Go to Settings > General.
2. Set Language to Deutsch.
3. Click Save Changes.
4. Go to Beiträge > Erstellen.
5. Add a Title in Titel hier eingeben.
6. Copy and paste Gärten, Garten, into the Schlagwörter meta box.
7. Click Veröffentlichen and then click Veröffentlichen again.
8. Refresh

Results

• In the Schlagwörter meta box, both Gärten and Garten appear.
• In Beiträge > Schlagwörter, Gärten is added with gaerten as its slug.
• In Beiträge > Schlagwörter, Garten is added with garten as its slug.

Notes

• The order of Gärten and Garten does not matter when added as tags, the result is the same.

[costdev]

Testing Report 2 of 2 (Classic Editor)

TL;DR

• Gärten is created with the gaerten slug.
• Garten isn't created.
• Issue reproduced.
• Ticket is valid.

Env

• WordPress: 5.8
• PHP: 7.4.18
• Localhost: WSL2 with Ubuntu 18.04
• OS: Windows 10
• Browser: Chrome 93.0.4577.82
• Theme: Twenty Twenty-One
• Plugins: Classic Editor
• Custom scripts: none

Steps to Test

1. Go to Settings > General.
2. Set Language to Deutsch.
3. Click Save Changes.
4. Go to Beiträge > Erstellen.
5. Add a Title in Titel hier eingeben.
6. Copy and paste Gärten, Garten, into the Schlagwörter meta box.
7. Click OK.
8. Click Veröffentlichen.

Results

• In the Schlagwörter meta box, only Gärten appears.
• In Beiträge > Schlagwörter, Gärten is added with gaerten as its slug.
• In Beiträge > Schlagwörter, Garten is not added.

Notes

• The order of Gärten and Garten does not matter when added as tags, the result is the same.

[costdev]

Pinging Editor Component Maintainers @azaozz, @matveb and @noisysocks to request Milestone.

[audrasjb]

Moving to milestone 5.9

[audrasjb]

Today's beta 1, so let's move this ticket to Future Release.

[Presskopp]

As an additional information:

Being on wp-admin/edit-tags.php?taxonomy=post_tag it's possible to enter \“!’$ as a tag and the ID of it will be used as the slug. Trying that on wp-admin/post.php?post=[ID]&action=edit the tag will not be saved.

[Presskopp]

Related: #47339, #58748