Gets a boolean value indicating whether this token represents a placeable. Always returns false for this class. Derived classes should override appropriately.

true iff the token is a general punctuation, an opening punctuation, or a closing punctuation

Gets a boolean value indicating whether this token can be substituted (e.g. auto-localized) across segments. All substitutables are placeables, but not all placeables can be substituted (e.g. acronyms).

Gets a value which indicates whether this token is a whitespace token or not.

true iff the token is a word, an abbreviation, or an acronym

Gets or sets the span covered by this token in the original segment.

Gets or sets the token's text.

Gets, or sets, the TokenType of this token.