d7171ae927
Fix tokenizer: Carriage returns after backslashes were not properly handled
2019-01-14 01:49:09 +01:00
d3d28480ed
Fix in diff parser: prefix calculation was wrong when copying nodes
2019-01-14 01:00:17 +01:00
564be7882e
Replace --print-diff with --print-code
2019-01-14 00:20:49 +01:00
76c5754b76
Fix diff parser generation for empty files
2019-01-13 23:38:35 +01:00
55247a5a2c
Docopt should not be needed for tests
2019-01-13 23:24:17 +01:00
7ae1efe5c7
Fix tokenizer: Form feeds and multiline docstrings didn't work together
2019-01-13 23:16:09 +01:00
01dba7f8ce
Fix diff parser: Need to calculate the prefix for the diff tokenizer better
2019-01-13 22:38:53 +01:00
ea8a758051
Remove copied nodes stuff, to simplify some things
2019-01-13 19:57:23 +01:00
a7e24a37e7
Fix newline endings and a few parser/copy counts
2019-01-13 19:55:18 +01:00
f80d9de7a0
Feature: The diff parser fuzzer is now able to use random Python fragments
...
This hopefully leads to the fuzzer finding more and faster issues in the diff
parser.
2019-01-13 16:00:36 +01:00
eaee2b9ca0
Fix: The Python 3.8 grammar did not include f-string support
2019-01-13 15:51:46 +01:00
dd1761da96
Fix tokenizer: Closing parentheses in the wrong place should not lead to strange behavior
2019-01-13 14:52:33 +01:00
e10802ab09
Fix end positions with error dedents
2019-01-13 14:14:16 +01:00
3d402d0a77
Fix diff parser tests for Python 2
2019-01-10 09:26:42 +01:00
f6a8b997f2
Randomize the fuzzer a bit more with inserting characters
2019-01-10 01:22:24 +01:00
94c2681c8e
Simplify the regexes
2019-01-10 01:21:56 +01:00
610a820799
Fix a regex clause that was totally wrong
2019-01-10 01:00:08 +01:00
57320af6eb
Fix another tokenizer issue
2019-01-09 00:55:54 +01:00
574e1c63e8
Apply \r changes in syntax trees
2019-01-09 00:34:19 +01:00
fbaad7883f
Actually make \r usable
2019-01-08 20:03:08 +01:00
b1f613fe16
Fix split lines for Python code
...
Some characters like Vertical Tab or File Separator were used as line separators.
This is not legal. Line Separators in Python are only Carriage Return \r and Line Feed \n.
2019-01-08 08:42:30 +01:00
f4696a6245
Add \r as a valid linebreak for splitlines
2019-01-07 18:46:16 +01:00
48c1a0e590
Move split_lines tests around
2019-01-07 18:40:34 +01:00
6f63147f69
Start generating really random strings with the fuzzer
2019-01-06 20:51:49 +01:00
94bd48bae1
Fix tokenizer: Dedents before error tokens are properly done, now.
2019-01-06 19:26:49 +01:00
edbceba4f8
Fix diff parser: Also check async with
2019-01-06 16:25:28 +01:00
b33c2b3ae1
Make the diff parser use a lot of different files by default
2019-01-06 15:43:37 +01:00
65a0748f4f
Fix diff parser: Forgot that with statments are also flows
2019-01-06 15:41:16 +01:00
c442cf98be
Fix valid graph asserting for some dedents that are errors
2019-01-06 12:39:04 +01:00
65b15b05e3
Fix diff parser: If funcs are not copied, errors shouldn't either
2019-01-06 11:39:51 +01:00
26aee1c6a9
Better documentation for the fuzz diff parser script
2019-01-06 01:10:15 +01:00
c88a862bae
Rename a test
2019-01-06 01:08:15 +01:00
d6b0585933
More verbose output for the diff fuzzer
2019-01-06 01:05:07 +01:00
6eba40b4c5
Fix diff parser: error dedent issues
2019-01-06 01:00:34 +01:00
428bde0573
Fix diff parser: Avoid indentation issues
2019-01-05 22:40:31 +01:00
d1d866f6c6
Use the right diff order in debug output
2019-01-05 18:36:48 +01:00
a8ec75fedd
Fix diff parser: The prefix was wrong in some copy cases
2019-01-05 18:33:38 +01:00
deaf1f310b
Make fuzz parser compatible with Python 2
2019-01-05 14:57:58 +01:00
2a881bf875
Make it possible to print all diffs in fuzzer
2019-01-05 14:50:59 +01:00
4d713f56e9
Introduce a redo flag 'only_last' to narrow down issues
2019-01-05 14:20:30 +01:00
d202fdea49
Add docopt to testing dependencies
2019-01-05 14:09:14 +01:00
5e6d5dec59
Rewrite the fuzz diff parser to cache errors (so we can re-run those)
2019-01-05 14:05:19 +01:00
c1846dd082
Fix diff parser: Decorators were sometimes parsed without their functions
2019-01-05 09:29:00 +01:00
5da51720cd
Fix tokenizer: Dedents should only happen after newlines
2019-01-03 11:44:17 +01:00
fde64d0eae
Usability for diff parser fuzzing
2019-01-02 17:31:07 +01:00
430f13af5e
Fix for diff parser: Rewrite prefix logic and don't mutate prematurely
2019-01-02 17:28:01 +01:00
96ae6a078b
Fix diff parser: positioning of functions if decorators were removed
2019-01-02 13:16:22 +01:00
a9f58b7c45
Ignore ERROR_DEDENT in graph validation
2019-01-02 12:15:05 +01:00
e0d0e57bd0
Add a small diff parser fuzzer
...
It should help us find the rest of the issues that the diff parser has
2019-01-02 11:26:31 +01:00
d2542983e9
Fix diff parser: get_last_line was sometimes wrong
...
Now the calculation is way simpler. Still annoying that it even happened.
2019-01-02 01:39:53 +01:00
Dave Halter