Commit Graph

350 Commits

Author SHA1 Message Date
Dave Halter
65df539e97 Better matching syntax errors. 2017-07-19 20:56:31 +02:00
Dave Halter
756587ae4a Add tests to check if python returns the same errors as the parser. 2017-07-19 20:54:23 +02:00
Dave Halter
6876e1b7c0 Use ERROR_DEDENT instead of ERRORTOKEN for wrong dedents. 2017-07-19 20:15:06 +02:00
Dave Halter
569cb99ca7 Start scanning for indentation errors. 2017-07-19 18:45:58 +02:00
Dave Halter
5e65bd2aaf Remove xfail tests that didn't make any sense. 2017-07-19 18:15:23 +02:00
Dave Halter
78c371f73a Refactor the version info to use a tuple, always. 2017-07-19 09:09:33 +02:00
Dave Halter
dc3b3158eb Move some code from one compatibility file to another. 2017-07-18 18:00:51 +02:00
Dave Halter
790bc459ed Make a proper recovery for only error statements in a suite. 2017-07-18 17:53:04 +02:00
Dave Halter
6ee986aa45 Remove some code that wasn't doing anything. 2017-07-17 08:49:02 +02:00
Dave Halter
837e9ca388 A paren wrongly used in __repr__. 2017-07-17 08:48:19 +02:00
Dave Halter
1a4539420d addtoken -> add_token. 2017-07-17 08:44:27 +02:00
Dave Halter
e3f7427c99 Restructure the Python 2 grammar to be closer to the original Python 2 grammar in case of list comprehensions. 2017-07-16 22:14:15 +02:00
Dave Halter
688dfaad24 Make ellipsis work for the differences between 2 and 3. 2017-07-16 18:49:19 +02:00
Dave Halter
33344d3ce4 Docstring changes. 2017-07-14 19:30:35 +02:00
Dave Halter
f6b3b1cc24 Make version a keyword only argument in load_grammar. 2017-07-14 18:28:03 +02:00
Dave Halter
1d0e982d89 Fix some stuff for Jedi. 2017-07-14 17:30:33 +02:00
Dave Halter
d32a84e181 Fix some default/annotation stuff. 2017-07-14 02:20:26 +02:00
Dave Halter
9d10ceeff1 Give jedi a better API for tokenizing. 2017-07-13 17:25:35 +02:00
Dave Halter
fcc6541f08 3.4 adaptions now everything in 3 is similar. 2017-07-13 08:59:40 +02:00
Dave Halter
e47667efb5 Make the 3.5 grammar more similar to its original. 2017-07-13 08:57:31 +02:00
Dave Halter
18d46878a2 Make the 3.6 grammar more similar to the original grammar. 2017-07-13 08:53:58 +02:00
Dave Halter
c6f18e42db Fix a py27 issue that was caused by changing grammars. 2017-07-13 08:46:52 +02:00
Dave Halter
d1d019b3c0 Some small grammar changes for 2.7. 2017-07-13 08:44:25 +02:00
Dave Halter
a647ee1f44 Finally fixed pretty much all the tests. 2017-07-12 23:11:04 +02:00
Dave Halter
b1dabc8596 Add the each_version fixture to a lot more parser tests. 2017-07-12 23:09:21 +02:00
Dave Halter
161c51b050 Fix some issues. 2017-07-12 23:00:37 +02:00
Dave Halter
4ffac4727c The parse shortcut now supports a version argument. 2017-07-12 22:56:17 +02:00
Dave Halter
b618c99b08 Octal fixes. 2017-07-12 22:28:54 +02:00
Dave Halter
70de06ed87 Fix annotations in grammar2.7. 2017-07-12 21:38:11 +02:00
Dave Halter
d7d1d67828 Refactor some tests to make sure cross parsing versions works. 2017-07-12 21:32:16 +02:00
Dave Halter
abc4852bd4 Write an abstraction to test if source code is valid for a certain python version or not. 2017-07-12 18:58:43 +02:00
Dave Halter
d3115acb33 Refactor a parse call. 2017-07-12 10:03:48 +02:00
Dave Halter
75d41c09cd Trying to run more tests in all versions against all versions. 2017-07-12 09:37:47 +02:00
Dave Halter
9772d64360 Remove strange features in grammar27 that are not part of the official grammar. 2017-07-12 09:09:01 +02:00
Dave Halter
e731eecdd8 Make the tokenizer version independent. 2017-07-11 23:29:44 +02:00
Dave Halter
b6022c7a80 Add total_ordering for python 2.6. 2017-07-11 00:33:26 +02:00
Dave Halter
c93546bfd9 Get tox -e py27 working. 2017-07-11 00:26:24 +02:00
Dave Halter
dd7c12834e Clarify when using print() is the right use or not. 2017-07-11 00:11:25 +02:00
Dave Halter
20fdc18ec5 We can now also test certain problems with python 2. 2017-07-10 23:57:36 +02:00
Dave Halter
069e9b57f2 Fix an issue for python 2. 2017-07-10 23:57:18 +02:00
Dave Halter
679851dbf1 Make it possible to use certain python versions according to the file name of a normalizer issue file. 2017-07-10 23:50:17 +02:00
Dave Halter
65203d197a Another bom fix in the pep8 normalizer. 2017-07-10 23:40:30 +02:00
Dave Halter
ff949d1061 Fix utf-8 bom positions. 2017-07-10 23:38:44 +02:00
Dave Halter
859c48170e Add the utf-8 bom to the prefix in the tokenizer. 2017-07-10 23:26:15 +02:00
Dave Halter
b3923e65e8 Try to add syntax errors to pep8 normalizing. 2017-07-10 23:04:54 +02:00
Dave Halter
53cf408d99 Add some tests for python error listing. 2017-07-09 16:57:27 +02:00
Dave Halter
ceed7f183e Make it possible to list errors easier in a Python tree. 2017-07-09 16:57:09 +02:00
Dave Halter
9899c703ea Fix a diff parser issue. 2017-07-09 11:55:23 +02:00
Dave Halter
5b5e4a0616 Generate error tokens in the tokenizer if the indentation is dedented wrongly. 2017-07-09 10:44:24 +02:00
Dave Halter
8ad37f6036 Move parsing the version around. 2017-07-09 00:49:23 +02:00