BottlScript

Lexical Analysis

1. Comment removal
2. Token generation

Tokenizer

Tokens can be keywords, constants, operators, identifiers, symbols.

int value = 100;

int (keyword), value (identifier), = (operator), 100 (constant) and ; (symbol)