rust-v1.0.0-beta.4
Pre-release
Pre-release
·
9 commits
to main
since this release
✨ Added
- Added two public iterator API's on
TokenizedBuffer
by @mishamsk in #9:iter_tokens
- returns an iterator over token indexesiter_tokens_infos
- returns an iterator over token infos- It uses the new public type:
TokenInfoIter
- It uses the new public type:
- New buffer API to get fully resolved token text:
get_token_resolved_text
instead of manually checking for string payload
✨ Changed
- Made
TokenInfo
public with read-only getters
🔥 Removed
- remove IntoIterator impl for TokenizedBuffer
💥 Fixed/Breaking
- Reworked macro var expression lexing, to properly account for trailing terminating dots. This is a breaking change, as the token types emitted by the lexer have changed. Now instead of one token
MacroVarExpr
for the entire expression, a sequence ofMacroVarResolve
,MacroString
and optionalMacroVarTerm
are emitted. by @mishamsk in #10
Full Changelog: rust-v1.0.0-beta.3...rust-v1.0.0-beta.4