Support \r and \r\n line breaks in tokenizer#54

Merged

andygrove merged 2 commits intoapache:masterfrom

nickolay:windows-newlines

Apr 27, 2019

Commits on Apr 25, 2019

Support \r and \r\n line breaks in tokenizer
nickolay
committed

Commits on Apr 26, 2019

Use `consume_and_return` when possible
nickolay
committed