Class CodeUnitLexer

java.lang.Object
org.antlr.v4.runtime.Recognizer<Integer,org.antlr.v4.runtime.atn.LexerATNSimulator>
org.antlr.v4.runtime.Lexer
org.pgcodekeeper.core.database.base.parser.CodeUnitLexer
All Implemented Interfaces:
org.antlr.v4.runtime.TokenSource
Direct Known Subclasses:
CHLexer, PrivilegesLexer, SQLLexer, TSQLLexer

public abstract class CodeUnitLexer extends org.antlr.v4.runtime.Lexer
Abstract base lexer class that tracks character offsets and positions for accurate source mapping, including support for 32-bit characters.

You should use this class instead of base Lexer to get actual characters offset in UTF-16 encoding.

  • Field Summary

    Fields inherited from class org.antlr.v4.runtime.Lexer

    _channel, _hitEOF, _input, _mode, _modeStack, _text, _token, _tokenStartCharIndex, _tokenStartCharPositionInLine, _tokenStartLine, _type, DEFAULT_MODE, DEFAULT_TOKEN_CHANNEL, HIDDEN, MAX_CHAR_VALUE, MIN_CHAR_VALUE, MORE, SKIP

    Fields inherited from class org.antlr.v4.runtime.Recognizer

    EOF
  • Method Summary

    Modifier and Type
    Method
    Description
    org.antlr.v4.runtime.Token
     
    org.antlr.v4.runtime.Token
     

    Methods inherited from class org.antlr.v4.runtime.Lexer

    emit, getAllTokens, getChannel, getChannelNames, getCharErrorDisplay, getCharIndex, getCharPositionInLine, getErrorDisplay, getErrorDisplay, getInputStream, getLine, getModeNames, getSourceName, getText, getToken, getTokenFactory, getTokenNames, getType, mode, more, nextToken, notifyListeners, popMode, pushMode, recover, recover, reset, setChannel, setCharPositionInLine, setInputStream, setLine, setText, setToken, setTokenFactory, setType, skip

    Methods inherited from class org.antlr.v4.runtime.Recognizer

    action, addErrorListener, getATN, getErrorHeader, getErrorListenerDispatch, getErrorListeners, getGrammarFileName, getInterpreter, getParseInfo, getRuleIndexMap, getRuleNames, getSerializedATN, getState, getTokenErrorDisplay, getTokenType, getTokenTypeMap, getVocabulary, precpred, removeErrorListener, removeErrorListeners, sempred, setInterpreter, setState

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
  • Method Details

    • emit

      public org.antlr.v4.runtime.Token emit()
      Overrides:
      emit in class org.antlr.v4.runtime.Lexer
    • emitEOF

      public org.antlr.v4.runtime.Token emitEOF()
      Overrides:
      emitEOF in class org.antlr.v4.runtime.Lexer