prose/parsek.prose.ast

Package-level declarations

Types

data class Paragraph(val sentences: List<Sentence>, val sourceRange: IntRange)

A paragraph within a TextDocument, separated from other paragraphs by blank lines.

data class Punctuation(val text: String, val sourceRange: IntRange) : Token

One or more punctuation characters grouped together.

data class Sentence(val tokens: List<Token>, val terminator: Punctuation?, val sourceRange: IntRange)

A sentence within a Paragraph.

data class TextDocument(val paragraphs: List<Paragraph>)

Root AST node for a plain-text document.

sealed interface Token

A granular token within a Sentence.

data class Whitespace(val text: String, val sourceRange: IntRange) : Token

One or more whitespace characters (spaces, tabs).

data class Word(val text: String, val sourceRange: IntRange) : Token

A word — a contiguous run of letters and/or digits.