Tokenizer: Enjoy improved handling of text and entities as the tokenizer now emits text before confirming entities, resulting in a smoother parsing experience.
Tokenizer: Experience enhanced performance with the introduction of sequences and fast forwarding, allowing the tokenizer to skip ahead in the buffer for specific characters.
Improvements
Tokenizer: Benefit from the fix that ensures non-string chunks are properly stringified, preventing errors during parsing.
Tokenizer: The tokenizer now decodes entities correctly after encountering a '<', improving the accuracy of parsed content.
Fixes
Fix regression issues that caused tests to fail when upgrading from version 7.0.0 to 7.1.0 or above, ensuring a stable experience for users.
Others
Refactor the tokenizer to reduce unnecessary string slices and concatenations, leading to a more efficient parsing process.