Releases: mishamsk/sas-lexer
Releases · mishamsk/sas-lexer
rust-v1.0.0-beta.4
✨ Added
- Added two public iterator API's on
TokenizedBuffer
by @mishamsk in #9:iter_tokens
- returns an iterator over token indexesiter_tokens_infos
- returns an iterator over token infos- It uses the new public type:
TokenInfoIter
- It uses the new public type:
- New buffer API to get fully resolved token text:
get_token_resolved_text
instead of manually checking for string payload
✨ Changed
- Made
TokenInfo
public with read-only getters
🔥 Removed
- remove IntoIterator impl for TokenizedBuffer
💥 Fixed/Breaking
- Reworked macro var expression lexing, to properly account for trailing terminating dots. This is a breaking change, as the token types emitted by the lexer have changed. Now instead of one token
MacroVarExpr
for the entire expression, a sequence ofMacroVarResolve
,MacroString
and optionalMacroVarTerm
are emitted. by @mishamsk in #10
Full Changelog: rust-v1.0.0-beta.3...rust-v1.0.0-beta.4
py-v1.0.0-beta.2
💥 Fixed/Breaking
- Reworked macro var expression lexing, to properly account for trailing terminating dots. This is a breaking change, as the token types emitted by the lexer have changed. Now instead of one token
MacroVarExpr
for the entire expression, a sequence ofMacroVarResolve
,MacroString
and optionalMacroVarTerm
are emitted. by @mishamsk in #10
Full Changelog: py-v1.0.0-beta.1...py-v1.0.0-beta.2
rust-v1.0.0-beta.3
py-v1.0.0-beta.1
✨ Added
- 🚀 Python initial pre-release.
rust-v1.0.0-beta.2
rust-v1.0.0-beta.1
✨ Added
- 🚀 Rust initial pre-release.
Full Changelog: https://github.com/mishamsk/sas-lexer/commits/rust-v1.0.0-beta.1