| commit | a24676bedcd332dd7e6fa5521d0449206391d190 | [log] [tgz] |
|---|---|---|
| author | Pablo Galindo Salgado <Pablogsal@gmail.com> | Tue Aug 24 17:50:05 2021 +0100 |
| committer | GitHub <noreply@github.com> | Tue Aug 24 17:50:05 2021 +0100 |
| tree | 45ccbb5c30c4debd12c08df5edbdb87e38353348 | |
| parent | 9ed523159c7ba840dbf403e02498eeae1b5d3ed9 [diff] |
Add tests for the C tokenizer and expose it as a private module (GH-27924)