Changeset 57489 for trunk/src/wp-includes/html-api/class-wp-html-tag-processor.php

Timestamp:

01/30/2024 10:07:42 PM (12 months ago)

Author:

dmsnell

Message:

HTML API: Fix splitting single text node.

When next_token() was introduced, it brought a subtle bug. When encountering a < in the HTML stream which did not lead to a tag or comment or other token, it was treating the full text span to that point as one text node, and the following span another text node.

The entire span should be one text node.

In this patch the Tag Processor properly detects this scenario and combines the spans into one text node.

Follow-up to [57348]

Props jonsurrell
Fixes #60385

File:

• trunk/src/wp-includes/html-api/class-wp-html-tag-processor.php (modified) (2 diffs)

trunk/src/wp-includes/html-api/class-wp-html-tag-processor.php

@@ -1513 +1513 @@
             $at = strpos( $html, '<', $at );
 
-            if ( $at > $was_at ) {
-                $this->parser_state         = self::STATE_TEXT_NODE;
-                $this->token_starts_at      = $was_at;
-                $this->token_length         = $at - $was_at;
-                $this->text_starts_at       = $was_at;
-                $this->text_length          = $this->token_length;
-                $this->bytes_already_parsed = $at;
-                return true;
-            }
-
             /*
              * This does not imply an incomplete parse; it indicates that there
@@ -1534 +1524 @@
                 $this->text_length          = $this->token_length;
                 $this->bytes_already_parsed = strlen( $html );
+                return true;
+            }
+
+            if ( $at > $was_at ) {
+                /*
+                 * A "<" has been found in the document. That may be the start of another node, or
+                 * it may be an "ivalid-first-character-of-tag-name" error. If this is not the start
+                 * of another node the "<" should be included in this text node and another
+                 * termination point should be found for the text node.
+                 *
+                 * @see https://html.spec.whatwg.org/#tag-open-state
+                 */
+                if ( strlen( $html ) > $at + 1 ) {
+                    $next_character  = $html[ $at + 1 ];
+                    $at_another_node =
+                        '!' === $next_character ||
+                        '/' === $next_character ||
+                        '?' === $next_character ||
+                        ( 'A' <= $next_character && $next_character <= 'z' );
+                    if ( ! $at_another_node ) {
+                        ++$at;
+                        continue;
+                    }
+                }
+
+                $this->parser_state         = self::STATE_TEXT_NODE;
+                $this->token_starts_at      = $was_at;
+                $this->token_length         = $at - $was_at;
+                $this->text_starts_at       = $was_at;
+                $this->text_length          = $this->token_length;
+                $this->bytes_already_parsed = $at;
                 return true;
             }