blob: 21c9095993630e7723d213b0ba1b78faf8e34222 [file] [log] [blame]
Tokenize module now implicitly emits a NEWLINE when provided with input that
does not have a trailing new line. This behavior now matches what the C
tokenizer does internally. Contributed by Ammar Askar.