Process next lexer rule
Processes the next rule and prepares the resulting token data.
This function has no parameters.
No value is returned.