Changeset 58188

Timestamp:

05/23/2024 07:54:17 PM (10 months ago)

Author:

dmsnell

Message:

Introduce Token Map: An optimized static translation class.

This patch introduces a new class: WP_Token_Map, designed for efficient
lookup and translation of static mappings between string keys or tokens, and
string replacements (for example, HTML character references).

The Token Map imposes certain restrictions on the byte length of the lookup
tokens and their replacements, but is a highly-optimized data structure for
mappings with a very high number of tokens.

Developed in ​https://github.com/WordPress/wordpress-develop/pull/5373
Discussed in https://core.trac.wordpress.org/ticket/60698

Fixes #60698.
Props: dmsnell, gziolo, jonsurrell, jorbin.

Location:

trunk

Files:

• src/wp-includes/class-wp-token-map.php (added)
• src/wp-includes/html-api/html5-named-character-references.php (added)
• src/wp-settings.php (modified) (2 diffs)
• tests/phpunit/data/html5-entities (added)
• tests/phpunit/data/html5-entities/README.md (added)
• tests/phpunit/data/html5-entities/entities.json (added)
• tests/phpunit/data/html5-entities/generate-html5-named-character-references.php (added)
• tests/phpunit/tests/wp-token-map (added)
• tests/phpunit/tests/wp-token-map/wpTokenMap.php (added)

trunk/src/wp-settings.php

@@ -108 +108 @@
 // Load early WordPress files.
 require ABSPATH . WPINC . '/class-wp-list-util.php';
+require ABSPATH . WPINC . '/class-wp-token-map.php';
 require ABSPATH . WPINC . '/formatting.php';
 require ABSPATH . WPINC . '/meta.php';
@@ -249 +250 @@
 require ABSPATH . WPINC . '/media.php';
 require ABSPATH . WPINC . '/http.php';
+require ABSPATH . WPINC . '/html-api/html5-named-character-references.php';
 require ABSPATH . WPINC . '/html-api/class-wp-html-attribute-token.php';
 require ABSPATH . WPINC . '/html-api/class-wp-html-span.php';