Commit Graph

10 Commits

Author SHA1 Message Date
Dave Halter
069e9b57f2 Fix an issue for python 2. 2017-07-10 23:57:18 +02:00
Dave Halter
ff949d1061 Fix utf-8 bom positions. 2017-07-10 23:38:44 +02:00
Dave Halter
859c48170e Add the utf-8 bom to the prefix in the tokenizer. 2017-07-10 23:26:15 +02:00
Dave Halter
7a7ad2038d Trying to change the prefix parsing a bit. 2017-06-29 22:47:31 +02:00
Dave Halter
34aabd6b47 Make the prefix parsing a bit simpler by combining tabs and spaces. 2017-06-07 17:23:07 +02:00
Dave Halter
814b16cc6c Remove the remove_newline hack and build that stuff into error recovery instead.
Tests are passing except for diff parser tests.
2017-05-31 21:24:24 +02:00
Dave Halter
b367058af6 Temporary work on carriage returns. 2017-05-31 08:59:49 +02:00
Dave Halter
8356bcab10 Fix small issues in prefix positioning. 2017-05-30 09:35:13 +02:00
Dave Halter
3e4b2f41cd Fix the token types. 2017-05-30 02:05:45 +02:00
Dave Halter
6640308d15 Add a prefix splitting. 2017-05-30 02:00:08 +02:00