Interface Token

All Known Implementing Classes:
Token.BasicToken

public interface Token
Represents a portion of a char sequence.
  • Method Details

    • getTokenizer

      Tokenizer getTokenizer()
      The Tokenizer that provided this token.
    • getName

      String getName()
      Returns the name.
    • getPattern

      String getPattern()
      Returns the pattern.
    • getInputStart

      int getInputStart()
      Returns the index of the start of this token in input.
    • getInputEnd

      int getInputEnd()
      Returns the index of the end of this token in input.
    • getLineIndex

      int getLineIndex()
      Returns the line index.
    • getLineStart

      int getLineStart()
      Returns the line start.
    • getColumnIndex

      int getColumnIndex()
      Returns the column index.
    • getSpecialToken

      Token getSpecialToken()
      Returns the special token.
    • getString

      String getString()
      Returns the string.