Fix tokenize_document
This commit is contained in:
parent
61feca1f41
commit
2afa33011a
|
@ -268,11 +268,11 @@ mod test {
|
|||
0,
|
||||
]: "10",
|
||||
[
|
||||
6,
|
||||
7,
|
||||
0,
|
||||
]: "pesti",
|
||||
[
|
||||
7,
|
||||
8,
|
||||
0,
|
||||
]: "23",
|
||||
}
|
||||
|
|
Loading…
Reference in New Issue