The Parle\Lexer class

Introduction

Single state lexer class. Lexemes can be defined on the fly. If the particular lexer instance is meant to be used with Parle\Parser, the token IDs need to be taken from there. Otherwise, arbitrary token IDs can be supplied. This lexer can give a certain performance advantage over Parle\RLexer, if no multiple states are required. Note, that Parle\RParser is not compatible with this lexer.

Class synopsis

Parle\Lexer
class Parle\Lexer {
/* Constants */
const int Parle\Lexer::ICASE = 1;
const int Parle\Lexer::DOT_NOT_LF = 2;
const int Parle\Lexer::DOT_NOT_CRLF = 4;
const int Parle\Lexer::SKIP_WS = 8;
const int Parle\Lexer::MATCH_ZERO_LEN = 16;
/* Properties */
public bool $bol = false;
public int $flags = 0;
public int $state = 0;
public int $marker = 0;
public int $cursor = 0;
/* Methods */
public void advance()
public void build()
public void callout(int $id, callable $callback)
public void consume(string $data)
public void dump()
public Parle\Token getToken()
public void insertMacro(string $name, string $regex)
public void push(string $regex, int $id)
public void reset(int $pos)
}

Predefined Constants

Parle\Lexer::ICASE

Parle\Lexer::DOT_NOT_LF

Parle\Lexer::DOT_NOT_CRLF

Parle\Lexer::SKIP_WS

Parle\Lexer::MATCH_ZERO_LEN

Properties

bol

Start of input flag.

flags

Lexer flags.

state

Current lexer state, readonly.

marker

Position of the latest token match, readonly.

cursor

Current input offset, readonly.

Table of Contents