| SimpleToken Properties |
The SimpleToken type exposes the following members.
| Name | Description | |
|---|---|---|
| IsPlaceable | IsPlaceable. Returns true if the token represents
an acronym, a variable, a URI, or a generic text placeable.
(Overrides TokenIsPlaceable.) | |
| IsPunctuation |
true iff the token is a general punctuation, an opening punctuation, or a closing punctuation
(Inherited from Token.) | |
| IsStopword |
Gets or sets whether this token is a stop word
| |
| IsSubstitutable | IsSubstitutable. Returns true if this token represents
a variable.
(Overrides TokenIsSubstitutable.) | |
| IsWhitespace |
Gets a value which indicates whether this token is a whitespace token or not.
(Inherited from Token.) | |
| IsWord |
true iff the token is a word, an abbreviation, or an acronym
(Inherited from Token.) | |
| Span |
Gets or sets the span covered by this token in the original segment.
(Inherited from Token.) | |
| Stem |
An optional stem to assign to this token. Stems are used for TM search and scoring.
| |
| Text |
Gets or sets the token's text.
(Inherited from Token.) | |
| Type |
Gets, or sets, the TokenType of this token.
(Inherited from Token.) |