Skip to content

rust-v1.0.0-beta.4

Pre-release
Pre-release
Compare
Choose a tag to compare
@mishamsk mishamsk released this 05 Jan 17:37
· 9 commits to main since this release
rust-v1.0.0-beta.4
e7ed10f

✨ Added

  • Added two public iterator API's on TokenizedBuffer by @mishamsk in #9:
    • iter_tokens - returns an iterator over token indexes
    • iter_tokens_infos - returns an iterator over token infos
      • It uses the new public type: TokenInfoIter
  • New buffer API to get fully resolved token text: get_token_resolved_text instead of manually checking for string payload

✨ Changed

  • Made TokenInfo public with read-only getters

🔥 Removed

  • remove IntoIterator impl for TokenizedBuffer

💥 Fixed/Breaking

  • Reworked macro var expression lexing, to properly account for trailing terminating dots. This is a breaking change, as the token types emitted by the lexer have changed. Now instead of one token MacroVarExpr for the entire expression, a sequence of MacroVarResolve, MacroString and optional MacroVarTerm are emitted. by @mishamsk in #10

Full Changelog: rust-v1.0.0-beta.3...rust-v1.0.0-beta.4