ce170e8aae
WIP: Try to use the tokenizer in a more native way
2020-04-02 02:00:35 +02:00
d674bc9895
Fix a backslash issue
2020-03-29 23:59:53 +02:00
0d9886c22a
Diff parser: Rewrite tokenizer modifications a bit
2020-03-29 22:41:59 +02:00
9f8a68677d
Tokenizer: It's now clearer when an error dedent appears
2020-03-29 13:50:36 +02:00
38b7763e9a
Use _assert_nodes_are_equal in the fuzzer
2020-03-28 14:51:27 +01:00
cf880f43d4
Tokenizer: Add error dedents only if parens are not open
2020-03-28 14:41:10 +01:00
29e3545241
Fix adding error indents/dedents only at the right places
2020-03-27 17:05:05 +01:00
4c42a82ebc
Allow multiple newlines in a suite, this makes the diff parser easier
2020-03-24 22:35:21 +01:00
43651ef219
Diff parser: Make sure dedent start pos are matching
2020-03-24 22:27:04 +01:00
2bef3cf6ff
Fix an issue where indents where repeated unnessecarily
2020-03-24 00:24:53 +01:00
c18c89eb6b
Diff parser: Correctly add indent issues
2020-03-23 00:16:47 +01:00
afc556d809
Diff parser: Prepare for indent error leaf insertion
2020-03-22 22:57:58 +01:00
cdb791fbdb
Diff parser: Add error dedents if necessary, see also davidhalter/jedi#1499
2020-03-22 21:37:25 +01:00
237dc9e135
Diff parser: Make sure to pop nodes directly after error nodes, see also davidhalter/jedi#1499
2020-03-22 14:49:22 +01:00
51a044cc70
Fix diff parser: Invalid dedents meant that sometimes the wrong parents were chosen, fixes davidhalter/jedi#1499
2020-03-22 12:41:19 +01:00
2cd0d6c9fc
Fix: Dedent omission was wrong, see davidhalter/jedi#1499
2020-03-22 12:41:19 +01:00
4090c80401
Remove Python 2.6 grammar
2020-01-05 23:55:03 +01:00
0a5b5f3346
Fix name tokenizing for Python 2
2019-07-13 15:34:23 +02:00
58850f8bfa
Rename a test
2019-02-06 09:51:46 +01:00
6c65aea47d
Fix working with async functions in the diff parser, fixes #56
2019-02-06 09:31:46 +01:00
bb2855897b
Escape a backslash properly
2019-01-24 00:31:26 +01:00
32a83b932a
Fix get_start_pos_of_prefix
2019-01-24 00:00:06 +01:00
ce8b531175
Fix diff parser: The previous fix was a bit off
2019-01-20 19:03:45 +01:00
0da0a8655a
Fix diff parser: issue with opening brackets
2019-01-20 00:41:11 +01:00
3d890c3a00
Async doesn't work in 3.4
2019-01-19 12:59:35 +01:00
956ea55048
Skip some tests for Python2.6 and Python3.3
2019-01-19 12:08:39 +01:00
0bd17bee2c
Fix diff parser: DEDENT as error leaves should also be ignored and reparsed
2019-01-18 18:41:08 +01:00
f3015efb2d
Fix diff parser: error dedents in between nodes should be ignored for now when copying
2019-01-18 02:43:12 +01:00
197391dc53
Fix diff parser: Don't copy error nodes/leaves in the beginning, leads to strange issues in some cases
2019-01-17 23:48:00 +01:00
52d01685ba
Fix diff parser: Don't copy DEDENT tokens at the beginning
2019-01-17 21:31:13 +01:00
e591b929eb
Fix diff parser: Skip last leaves for last line offset leaves
2019-01-17 00:15:38 +01:00
dac4c445a7
Fix indentation error tokens
2019-01-16 23:21:31 +01:00
20fd32b45d
Fix diff parser: Avoid side effects for prefix
2019-01-14 21:37:19 +01:00
d3d28480ed
Fix in diff parser: prefix calculation was wrong when copying nodes
2019-01-14 01:00:17 +01:00
7ae1efe5c7
Fix tokenizer: Form feeds and multiline docstrings didn't work together
2019-01-13 23:16:09 +01:00
01dba7f8ce
Fix diff parser: Need to calculate the prefix for the diff tokenizer better
2019-01-13 22:38:53 +01:00
a7e24a37e7
Fix newline endings and a few parser/copy counts
2019-01-13 19:55:18 +01:00
e10802ab09
Fix end positions with error dedents
2019-01-13 14:14:16 +01:00
3d402d0a77
Fix diff parser tests for Python 2
2019-01-10 09:26:42 +01:00
94c2681c8e
Simplify the regexes
2019-01-10 01:21:56 +01:00
610a820799
Fix a regex clause that was totally wrong
2019-01-10 01:00:08 +01:00
57320af6eb
Fix another tokenizer issue
2019-01-09 00:55:54 +01:00
574e1c63e8
Apply \r changes in syntax trees
2019-01-09 00:34:19 +01:00
fbaad7883f
Actually make \r usable
2019-01-08 20:03:08 +01:00
b1f613fe16
Fix split lines for Python code
...
Some characters like Vertical Tab or File Separator were used as line separators.
This is not legal. Line Separators in Python are only Carriage Return \r and Line Feed \n.
2019-01-08 08:42:30 +01:00
94bd48bae1
Fix tokenizer: Dedents before error tokens are properly done, now.
2019-01-06 19:26:49 +01:00
edbceba4f8
Fix diff parser: Also check async with
2019-01-06 16:25:28 +01:00
65a0748f4f
Fix diff parser: Forgot that with statments are also flows
2019-01-06 15:41:16 +01:00
c442cf98be
Fix valid graph asserting for some dedents that are errors
2019-01-06 12:39:04 +01:00
65b15b05e3
Fix diff parser: If funcs are not copied, errors shouldn't either
2019-01-06 11:39:51 +01:00
Dave Halter