loading code fetching the highlighted snippet
Word tokens preserve spaces, tabs, punctuation, and case. Apostrophes and hyphens separate word runs. Unicode letters, marks, numbers, and underscores form runs; continuous CJK text is one token and emoji grapheme clusters are not guaranteed atomic. Cleanup applies only to character mode.
Word tokens preserve spaces, tabs, punctuation, and case. Apostrophes and hyphens separate word runs. Unicode letters, marks, numbers, and underscores form runs; continuous CJK text is one token and emoji grapheme clusters are not guaranteed atomic. Both cleanup props are ignored in word mode. The raw character pane disables cleanup.