Interface State

Tokenized input

Read pointer into the input array.

Next state of the lexer's state machine: TEXT, or TAG/nl/ws

Current processing tag TagType, or boolean if none.

Raw input text

The current token being parsed

Memberof

BBToken

Whether to "unget" the last token.

In verbatim mode, we return all input, unparsed, including comments.