Skip to content

Commit

Permalink
Subtyping will autocoerce lifetimes by itself
Browse files Browse the repository at this point in the history
  • Loading branch information
sftse committed Dec 28, 2024
1 parent 4ab3f84 commit 4db4cf6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tokenizers/src/models/bpe/model.rs
Original file line number Diff line number Diff line change
Expand Up @@ -460,7 +460,7 @@ impl BPE {
Ok(word)
}

fn word_to_tokens<'a, 'b: 'a>(&'a self, word: &'b Word) -> impl Iterator<Item = Token> + 'a {
fn word_to_tokens<'a>(&'a self, word: &'a Word) -> impl Iterator<Item = Token> + 'a {
word.get_chars_iter()
.zip(word.get_offsets_iter())
.map(move |(id, offsets)| Token::new(id, self.vocab_r[&id].clone(), offsets))
Expand Down

0 comments on commit 4db4cf6

Please sign in to comment.