Lexer¶
bcql_py.parser.lexer
¶
BCQLLexer
¶
View source on GitHub: src/bcql_py/parser/lexer.py lines 10–15
tokenize
¶
We assume the base case where the token can be a sequence of [] tokens or "" or '' or a sequence of alphanumeric characters and underscores.
View source on GitHub: src/bcql_py/parser/lexer.py lines 232–489