 Dave Halter
|
61e2bba380
|
Tests and implementation to remove the last newline again in the parser tree, to be able to exactly reproduce the parser input.
|
2015-01-26 21:07:14 +01:00 |
|
|
Dave Halter
|
446f5b9018
|
Fix issues with the right count of parsers used.
|
2015-01-24 20:19:03 +01:00 |
|
|
Dave Halter
|
4d6afd3c99
|
Fix fast parser tests.
|
2015-01-24 00:06:16 +01:00 |
|
|
Dave Halter
|
d6b3b76d26
|
First fast parser version that actually let a test pass.
|
2015-01-19 00:39:51 +01:00 |
|
|
Dave Halter
|
cf223a71f5
|
Add a position modifier for the fast parser. Not yet in use though.
|
2015-01-15 13:57:56 +01:00 |
|
|
Dave Halter
|
cc64265187
|
Grammar modifications so that the Python2.7 grammar looks more like the Python 3.4 grammar.
|
2015-01-13 01:05:13 +01:00 |
|
|
Dave Halter
|
f59e05f8e7
|
Switch grammars depending on Python version.
|
2015-01-12 13:33:44 +01:00 |
|
|
Dave Halter
|
582b9b01af
|
Get invalid INDENTs working.
The following DEDENT's are removed.
|
2015-01-12 12:22:57 +01:00 |
|
|
Dave Halter
|
5c98f6cf04
|
Suites don't have to contain statements anymore, this makes autocompletion better in certain cases.
|
2015-01-12 01:11:46 +01:00 |
|
|
Dave Halter
|
83a94c12c9
|
Correct global name issues.
|
2015-01-08 01:20:53 +01:00 |
|
|
Dave Halter
|
d9d3740c92
|
Trying to replace the old pgen2 token module with a token module more tightly coupled to the standard library.
|
2014-12-16 01:52:15 +01:00 |
|
|
Dave Halter
|
eaace104dd
|
Replace the tokenizer's output with a tuple (switching back from a Token class).
|
2014-12-16 00:10:07 +01:00 |
|
|
Dave Halter
|
680fdd574b
|
Remove some old unused tokenize stuff.
|
2014-12-15 17:44:40 +01:00 |
|
|
Dave Halter
|
b911a39fb4
|
The driver file is now empty.
|
2014-12-15 17:27:27 +01:00 |
|
|
Dave Halter
|
55a6dbc8a2
|
Remove the old driver code of pgen2.
|
2014-12-15 17:18:01 +01:00 |
|
|
Dave Halter
|
4e0172a915
|
Partial parser.__init__' cleanup.
|
2014-12-15 16:21:35 +01:00 |
|
|
Dave Halter
|
af303e10c8
|
Statement -> ExprStmt.
|
2014-12-15 16:18:09 +01:00 |
|
|
Dave Halter
|
bb747a83e8
|
Small fix with big impact for the previously done simple_stmt error recovery. Now it actually works.
|
2014-12-07 19:45:19 +01:00 |
|
|
Dave Halter
|
db636c35ae
|
Error recovery should not delete parts of simple_stmt.
|
2014-12-07 18:04:55 +01:00 |
|
|
Dave Halter
|
425741e285
|
Fix assertion/isinstance type information.
|
2014-12-02 17:45:19 +01:00 |
|
|
Dave Halter
|
3cc4da28ed
|
Fix lambda_nocond.
|
2014-12-01 11:56:28 +01:00 |
|
|
Dave Halter
|
bcd998ae02
|
Lambdas are own namespaces and deserve their own used_names dictionary in the parser.
|
2014-12-01 11:49:52 +01:00 |
|
|
Dave Halter
|
88853c78f4
|
Get lambdas mostly working.
|
2014-12-01 02:47:48 +01:00 |
|
|
Dave Halter
|
417db4e83f
|
suites without indent can also be deleted.
|
2014-11-29 13:30:21 +01:00 |
|
|
Dave Halter
|
a7560069b0
|
Fixes for issues with empty compound_stmt. We always remove a whole stmt and just a funcdef as an error correction.
|
2014-11-29 13:25:31 +01:00 |
|
|
Dave Halter
|
3fb1934462
|
Fix invalid test issues.
|
2014-11-29 01:35:26 +01:00 |
|
|
Dave Halter
|
2b912cb75a
|
The func/class dictionaries must be changed if some scopes are removed by the parser's error recovery.
|
2014-11-29 01:29:21 +01:00 |
|
|
Dave Halter
|
43c01afcfc
|
invalid.py test changes. Error recovery will be different from the old one.
|
2014-11-28 21:58:44 +01:00 |
|
|
Dave Halter
|
2c684906e3
|
Working with dedents in error recovery.
|
2014-11-28 21:33:40 +01:00 |
|
|
Dave Halter
|
31600b9552
|
classes and functions are new statements and should never get removed by the error recovery.
|
2014-11-28 02:44:34 +01:00 |
|
|
Dave Halter
|
e1d6511f2f
|
Trying to move the indent/dedent logic back into the tokenizer.
|
2014-11-28 02:04:04 +01:00 |
|
|
Dave Halter
|
97516eb26b
|
The new tokenizer is more or less working now. Indents are calculated as they should
|
2014-11-27 16:03:58 +01:00 |
|
|
Dave Halter
|
c0df7003a5
|
Allow both the old tokenizer and the new one (able to toggle).
|
2014-11-27 01:12:49 +01:00 |
|
|
Dave Halter
|
cc1098b93c
|
Fix a few tokenize tests and merge them back together.
|
2014-11-26 16:09:28 +01:00 |
|
|
Dave Halter
|
5d82b11f59
|
First implementation to be ready to complete corrupt imports. Working ok.
|
2014-11-25 19:35:27 +01:00 |
|
|
Dave Halter
|
e72eaf7a59
|
on import completion preparations.
|
2014-11-25 15:10:36 +01:00 |
|
|
Dave Halter
|
db76bbccc5
|
Trying to change the symbols in node. They are now strings.
With this change we are finally able to get rid of parser/pytree.py
|
2014-11-24 01:52:41 +01:00 |
|
|
Dave Halter
|
9f45f18ad1
|
Added a grammar param to the parser.
|
2014-11-24 01:10:39 +01:00 |
|
|
Dave Halter
|
c152a1c58b
|
Actually replace tree with representation (in all the imports).
|
2014-11-23 19:46:52 +01:00 |
|
|
Dave Halter
|
0f21d38e2c
|
Remove the old parser.
|
2014-11-23 19:17:50 +01:00 |
|
|
Dave Halter
|
ce5d428d22
|
At least functions generate docstrings again.
|
2014-11-20 01:37:18 +01:00 |
|
|
Dave Halter
|
3c6d5dafb1
|
Split Import, now there is ImportFrom and ImportName as it exists in the python grammar.
|
2014-11-19 00:40:16 +01:00 |
|
|
Dave Halter
|
a4a767f8bb
|
Import improvements.
|
2014-11-18 17:19:15 +01:00 |
|
|
Dave Halter
|
f62f181066
|
First decorator implementations.
|
2014-11-17 22:24:54 +01:00 |
|
|
Dave Halter
|
13a128b160
|
global working.
|
2014-11-13 18:13:56 +01:00 |
|
|
Dave Halter
|
cc661473bc
|
Trying to change used_names, so that they don't contain name definitions from CompFor.
|
2014-11-11 17:13:27 +01:00 |
|
|
Dave Halter
|
70bc6642d8
|
symbols on the stack are now defined with a smaller tuple.
|
2014-11-05 10:27:24 +01:00 |
|
|
Dave Halter
|
3b4a8dcd7e
|
convert: run away from tuples.
|
2014-11-04 19:26:33 +01:00 |
|
|
Dave Halter
|
73bd576bb2
|
Merged some convert stuff.
|
2014-11-04 19:12:02 +01:00 |
|
|
Dave Halter
|
3518123afa
|
Moved the convert function away from pytree
|
2014-11-04 19:09:58 +01:00 |
|