Commit Graph

546 Commits

Author SHA1 Message Date
Dave Halter 3818fb2b22 Some more refactorings for clarification 2018-06-13 01:44:44 +02:00
Dave Halter 95ddeb4012 Factor out start_symbol into a better position 2018-06-13 00:54:18 +02:00
Dave Halter f638abb08e Refactor out dfas 2018-06-13 00:31:45 +02:00
Dave Halter f8558df27a Document pgen grammars a bit better 2018-06-13 00:27:51 +02:00
Dave Halter bae56e72e1 addarc -> add_arc 2018-06-12 22:13:08 +02:00
Dave Halter 41c38311f7 Refactor some things in pgen 2018-06-12 22:08:19 +02:00
Dave Halter eeb456a6d4 Move some initializations 2018-06-12 22:00:49 +02:00
Dave Halter 1c0956d9e0 Change license again. The year shouldn't matter 2018-06-12 21:58:27 +02:00
Dave Halter c17156bd36 Make first private 2018-06-12 21:56:26 +02:00
Dave Halter 8865aa452c Change copyright years 2018-06-12 21:55:37 +02:00
Dave Halter e0c79a9fcc Remove some code from the grammar 2018-06-12 21:49:18 +02:00
Dave Halter 3c08b1b058 Separate the grammar generation from the grammar parsing 2018-06-12 21:30:09 +02:00
Dave Halter 0f32673092 In pgen now everything is named grammar and not c 2018-06-12 18:17:02 +02:00
Dave Halter 1e18163402 Better recovery for online classes and functions 2018-06-12 13:23:49 +02:00
Dave Halter cef9f1bdbd Fix one-line error recovery for all things that are using a suite
Fixes https://github.com/davidhalter/jedi/issues/1138.
2018-06-12 12:56:27 +02:00
Dave Halter 23db71a5f7 Add a debug function for first tokens 2018-06-12 01:50:37 +02:00
Dave Halter 6f385bdba1 Not testing Python 3.3 anymore on travis. It seems to be broken v0.2.1 2018-05-21 12:55:49 +02:00
Dave Halter 4fc31c58b3 Add a changelog for 0.2.1 2018-05-21 12:48:31 +02:00
Dave Halter 689decc66c Push the version 2018-05-21 12:44:10 +02:00
Dave Halter c2eacdb81c The diff parser was slighly off with prefixes, fixes #1121 2018-05-20 19:13:50 +02:00
Dave Halter ac0bf4fcdd A better repr for the endmarker 2018-05-17 09:56:16 +02:00
Dave Halter 948f9ccecc Merge branch 'master' of github.com:davidhalter/parso 2018-04-23 23:42:11 +02:00
Dave Halter f20106d88e Fix a prefix issue with error leafs. 2018-04-22 19:28:30 +02:00
Aaron Meurer f4912f6c17 Use the correct field name in the PythonToken repr 2018-04-19 22:20:23 +02:00
Jonas Tranberg bf5a4b7c2c Added path param to load_grammar for loading custom grammar files 2018-04-19 10:16:33 +02:00
Dave Halter 579146b501 Don't test python 2.6 in tox by default, because the newer pip versions don't support it anymore v0.2.0 2018-04-15 14:46:35 +02:00
Dave Halter deb4dbce1c Set a release date 2018-04-15 13:54:10 +02:00
Dave Halter 8eda8decea Fix whitespace issues with prefixes 2018-04-07 15:34:58 +02:00
Dave Halter f6935935c0 Use proper leafs for fstring start/end 2018-04-07 12:32:33 +02:00
Dave Halter d3fa7e1cad Fix a Python 2 related issue. 2018-04-07 11:14:41 +02:00
Dave Halter 83d9abd036 Forgot to delete another print. WTF I'm tired 2018-04-07 02:22:45 +02:00
Dave Halter 222e9117b4 Unfortunately forgot to delete a print 2018-04-07 02:21:59 +02:00
Dave Halter eda2207e6c Start to write a changelog for 0.2.0 2018-04-07 02:20:00 +02:00
Dave Halter a91e5f2775 Merge branch 'fstrings'
f-strings are now parsed as part of the Python grammar and not in separate
steps.

Note that this is not the way that CPython does it. CPython still uses multiple
parse steps in ast.c.
2018-04-07 02:17:02 +02:00
Dave Halter cba4f2ccc1 Fix the syntax errors from f-strings 2018-04-07 02:14:35 +02:00
Dave Halter 8f1a436ba1 Remove the old f-string grammar and fix the tests with the new syntax 2018-04-07 02:11:26 +02:00
Dave Halter 9941348ec6 Add python 3.7 to tox 2018-04-06 20:30:07 +02:00
Dave Halter afb71dc762 Remove the f-string rules and replace them with new ones 2018-04-06 20:29:22 +02:00
Dave Halter 0d96b12566 Fix the fstring syntax if there's a conversion with exclamation mark 2018-04-06 09:59:15 +02:00
Dave Halter 9d2ce4bcd4 Fix a few fstring error gatherings 2018-04-06 09:50:07 +02:00
Dave Halter a3e280c2b9 Use strings as a non-terminal symbol in all grammars
This makes it easier to write the same logic for all Python versions
2018-04-05 09:55:19 +02:00
Dave Halter 7c7f4f4e54 Fix a test 2018-04-05 00:45:23 +02:00
Dave Halter 56b3e2cdc8 Also use the fstring modfications for the 3.7 grammar 2018-04-05 00:45:03 +02:00
Dave Halter 97f042c6ba Remove clutter from the grammar 2018-03-31 14:26:12 +02:00
Dave Halter b1aa7c6a79 Cleanup a lot of details in the tokenizer for fstrings 2018-03-31 14:25:29 +02:00
Dave Halter 235fda3fbb Fix a few things so that the tokenizer can at least parse the grammar. 2018-03-30 22:13:18 +02:00
Dave Halter d8d2e596a5 A first implementation of the fstring tokenizer 2018-03-30 20:50:49 +02:00
Dave Halter e05ce5ae31 Revert "A small improvement in checks"
The problem with this commit is that it probably makes some checks slower. It's
still slightly more beautiful, but we leave it for now.

This reverts commit 25e4ea9c24.
2018-03-28 09:51:37 +02:00
Dave Halter 25e4ea9c24 A small improvement in checks 2018-03-28 02:16:37 +02:00
Dave Halter 9f88fe16a3 Added the fstring grammar without the tokenization part
This means that fstrings are not yet parsed, because there are no f-string tokens.
2018-03-28 02:03:18 +02:00