Token
A granular token within a Sentence.
Every token carries the original text and a sourceRange mapping back to character offsets in the source document, enabling precise cursor positioning and selection in an editor.
A granular token within a Sentence.
Every token carries the original text and a sourceRange mapping back to character offsets in the source document, enabling precise cursor positioning and selection in an editor.