- Maintenance release after updating dependencies
- Added SCSS tokenization as
@csstools/tokenizer/tokenizeSCSS
.
- Changes the shape of tokens from an array to an object.
- Changes the named export from
tokenizer
totokenize
. - Changes the global IIFE export from
cssTokenizer
totokenizeCSS
.
- Fixes an issue consuming digits after a number that begins with a decimal.
- Fixes an issue where string tokens incorrectly put the lead quotation in the main value.
- Supports function token (previously an identifier token followed by a parenthesis delimiter token).
- Changes from default export to named export (
tokenizer
).
Initial version