9f8a68677d
Tokenizer: It's now clearer when an error dedent appears
2020-03-29 13:50:36 +02:00
a950b82066
Fix tokenizer for random invalid unicode points
2020-03-28 21:02:04 +01:00
38b7763e9a
Use _assert_nodes_are_equal in the fuzzer
2020-03-28 14:51:27 +01:00
cf880f43d4
Tokenizer: Add error dedents only if parens are not open
2020-03-28 14:41:10 +01:00
8e49d8ab5f
Fix tokenizer fstring end positions
2020-03-28 11:22:32 +01:00
29e3545241
Fix adding error indents/dedents only at the right places
2020-03-27 17:05:05 +01:00
3d95b65b21
Fix an issue with unfinished f string literals
2020-03-27 11:17:31 +01:00
4c42a82ebc
Allow multiple newlines in a suite, this makes the diff parser easier
2020-03-24 22:35:21 +01:00
43651ef219
Diff parser: Make sure dedent start pos are matching
2020-03-24 22:27:04 +01:00
2bef3cf6ff
Fix an issue where indents where repeated unnessecarily
2020-03-24 00:24:53 +01:00
c18c89eb6b
Diff parser: Correctly add indent issues
2020-03-23 00:16:47 +01:00
afc556d809
Diff parser: Prepare for indent error leaf insertion
2020-03-22 22:57:58 +01:00
cdb791fbdb
Diff parser: Add error dedents if necessary, see also davidhalter/jedi#1499
2020-03-22 21:37:25 +01:00
d3ceafee01
Specify in tests how another dedent issue is recovered from
2020-03-22 19:34:12 +01:00
237dc9e135
Diff parser: Make sure to pop nodes directly after error nodes, see also davidhalter/jedi#1499
2020-03-22 14:49:22 +01:00
51a044cc70
Fix diff parser: Invalid dedents meant that sometimes the wrong parents were chosen, fixes davidhalter/jedi#1499
2020-03-22 12:41:19 +01:00
2cd0d6c9fc
Fix: Dedent omission was wrong, see davidhalter/jedi#1499
2020-03-22 12:41:19 +01:00
a47b5433d4
Make sure iter_funcdefs includes async functions with decorators, fixes #98
2020-01-26 20:00:56 +01:00
84874aace3
Revision on fstring issues ( #100 )
...
* f-string expression part cannot include a backslash
* failing example `f"{'\n'}"` for tests
2020-01-09 21:49:34 +01:00
55531ab65b
Revision on assignment errors ( #97 )
...
* Revision on assignment expression errors
* added rule for __debug__ (should be a keyword)
* reviewed error messages
* added new failing samples
* Adjustment upon Dave's review
* rewind several changes in assignment errors
* patched is_definition: command not found for assignment expressions
* patched Python 2 inconsistent error messages in test_python_errors.py: command not found
2020-01-08 23:07:37 +01:00
cfef1d74e7
Fix a Python 2.7 issue
2020-01-06 00:02:26 +01:00
9ee7409d8a
Get rid of Python 3.3 artifacts
2020-01-05 23:59:38 +01:00
4090c80401
Remove Python 2.6 grammar
2020-01-05 23:55:03 +01:00
95f353a15f
Merge branch 'rm-2.6' of https://github.com/hugovk/parso
2020-01-05 23:50:20 +01:00
2b0b093276
Make sure to limit the amount of cached files parso stores, fixes davidhalter/jedi#1340
2020-01-05 23:44:51 +01:00
ceb1ee81fa
Merge pull request #93 from yangyangxcf/fstring_tokenize
...
fixed #86 and #87
2019-12-15 00:47:32 +01:00
753e1999fe
Fix: Add more cases for named expression errors, see #89 , #90
2019-12-15 00:04:38 +01:00
5f04dad9ab
Fix: Catch some additional cases named expr errors, see #89 , #90
2019-12-14 23:31:43 +01:00
dbba1959f7
Make sure that function executions are errors as well, see #90
2019-12-14 23:23:00 +01:00
32584ac731
Merge https://github.com/JarryShaw/parso into master
2019-12-14 22:21:22 +01:00
89c4d959e9
* moved all namedexpr_test related rules to _NamedExprRule
...
* added valid examples
2019-12-14 09:37:16 +01:00
776e151370
Revised implementation
...
* search ancestors of namedexpr_test directly for comprehensions
* added test samples for invalid namedexpr_test syntax
2019-12-13 11:55:53 +08:00
b90e5cd758
fixed #86 and #87
2019-12-05 19:22:58 +08:00
e496b07b63
Fix trailing comma error
2019-12-04 22:59:24 +01:00
3ecd4dddb4
Fix is_definition test
2019-09-05 23:28:46 +02:00
e8653a49ff
Make is_definition work on setitem modifications, see #66
2019-09-04 09:52:55 +02:00
f6bdba65c0
Drop support for EOL Python 2.6
2019-08-08 14:56:27 +03:00
e723b3e74b
Refactor the ambiguity tests a bit, see #70
2019-07-13 20:15:56 +02:00
0032bae041
Make pgen2's grammar ambiguity detection handle more cases
...
Under the old implementation,
```
outer: A [inner] B C
inner: B C [inner]
```
wouldn't get detected as the ambiguous grammar that it is, whereas
```
outer: A rest
rest: [inner] B C
inner: B C [inner]
```
would.
This would manifest itself as non-determinism in the DFA state
generation. See the discussion #62 on for a full explanation.
This modifies the ambiguity detection to work on a broader class of
issues, so it should now hopefully detect all cases where the given
grammar is ambiguous.
At some point, we could extend this logic to allow developers to
optionally set precedence of grammar productions, which could resolve
ambiguities, but that's not a strict requirement for parsing python.
2019-07-13 20:04:32 +02:00
0a5b5f3346
Fix name tokenizing for Python 2
2019-07-13 15:34:23 +02:00
99dd4a84d4
Merge branch 'master' of github.com:davidhalter/parso
2019-07-12 21:35:06 +02:00
9501b0bde0
Fixed name tokenizing issues for tamil characters, fixes davidhalter/jedi#1368
2019-07-12 21:31:49 +02:00
ad57a51800
Fix line continuation characters inside f-strings
...
Line continuation characters are valid inside of strings, but weren't
handled correctly in certain cases with f-strings, due to some small
tokenizer bugs.
This pull request to address those issues, and adds tests to validate
the new logic.
2019-07-12 21:20:00 +02:00
ecbe2b9926
Add positional only arguments to grammar
2019-06-09 21:15:03 +02:00
a7aa23a7f0
Parse named expressions
2019-06-02 23:34:37 +02:00
5430415d44
Change a test, because it doesn't really matter
...
The test had changed behavior for Python 3.8, a syntax error of:
SyntaxError: unexpected EOF while parsing
instead of
SyntaxError: invalid syntax
2019-06-02 22:54:45 +02:00
6cdd47fe2b
f-string syntax in Python 3.8 was enhanced
...
See e.g. https://twitter.com/raymondh/status/1135253771846471680
2019-06-02 22:48:47 +02:00
917b4421f3
Fix fstring format spec parsing, fixes #74
2019-06-02 15:18:42 +02:00
93ddf5322a
parse long number notation ( #72 )
...
* parse long number notation
* parse long number notation
2019-06-02 11:14:15 +02:00
b2ab64d8f9
Fix Python 3.8 error issues
2019-04-05 18:30:48 +02:00
Dave Halter