Crate gruel_lexer

Crate gruel_lexer 

Source
Expand description

Lexer for the Gruel programming language.

Converts source text into a sequence of tokens for parsing. Uses logos for efficient tokenization.

Structs§

FileId
A file identifier used to track which source file a span belongs to.
Lexer
Logos-based lexer that converts source text into tokens.
Spur
The default key for every Rodeo, uses only 32 bits of space
ThreadedRodeo
A concurrent string interner that caches strings quickly with a minimal memory footprint, returning a unique key to re-access it with O(1) internment and resolution.
Token
A token with its kind and source span.

Enums§

TokenKind
Token kinds in the Gruel language.

Traits§

Key
Types implementing this trait can be used as keys for all Rodeos