Dave Halter
|
5730e5add0
|
parser tree docstring updates.
|
2014-12-16 18:10:28 +01:00 |
|
Dave Halter
|
e53e211325
|
Python 2 compatibility in fake module.
|
2014-12-16 02:07:20 +01:00 |
|
Dave Halter
|
d5e3a09c44
|
Python 2 compatibility with the new tokens.
|
2014-12-16 02:03:05 +01:00 |
|
Dave Halter
|
fd1cb86765
|
Now able to remove both tokenize and token from pgen2.
|
2014-12-16 02:00:33 +01:00 |
|
Dave Halter
|
d9d3740c92
|
Trying to replace the old pgen2 token module with a token module more tightly coupled to the standard library.
|
2014-12-16 01:52:15 +01:00 |
|
Dave Halter
|
eaace104dd
|
Replace the tokenizer's output with a tuple (switching back from a Token class).
|
2014-12-16 00:10:07 +01:00 |
|
Dave Halter
|
680fdd574b
|
Remove some old unused tokenize stuff.
|
2014-12-15 17:44:40 +01:00 |
|
Dave Halter
|
955f125c0d
|
Trying to remove token from pgen2.
|
2014-12-15 17:36:15 +01:00 |
|
Dave Halter
|
491b4ad76d
|
Pgen2 license amendments.
|
2014-12-15 17:29:32 +01:00 |
|
Dave Halter
|
b911a39fb4
|
The driver file is now empty.
|
2014-12-15 17:27:27 +01:00 |
|
Dave Halter
|
55a6dbc8a2
|
Remove the old driver code of pgen2.
|
2014-12-15 17:18:01 +01:00 |
|
Dave Halter
|
4e0172a915
|
Partial parser.__init__' cleanup.
|
2014-12-15 16:21:35 +01:00 |
|
Dave Halter
|
af303e10c8
|
Statement -> ExprStmt.
|
2014-12-15 16:18:09 +01:00 |
|
Dave Halter
|
8eaa008b5f
|
Fix try/except checks in static analysis.
|
2014-12-12 02:26:16 +01:00 |
|
Dave Halter
|
77fdbac234
|
static analysis: Import tests working again.
|
2014-12-11 16:25:18 +01:00 |
|
Dave Halter
|
6818d3affa
|
Implement Import.is_nested method.
|
2014-12-11 16:17:07 +01:00 |
|
Dave Halter
|
6afc5ccca5
|
Few docstring fixes.
|
2014-12-11 15:32:45 +01:00 |
|
Dave Halter
|
936a3c9dfe
|
Small cleanup: Removed a few print statements.
|
2014-12-08 16:03:23 +01:00 |
|
Dave Halter
|
01b9361b33
|
Reenable keyword completion.
|
2014-12-08 15:14:27 +01:00 |
|
Dave Halter
|
0ad6aeba6b
|
Fix some API classes issues. Among them call signature generation and Definition.parent() issues.
|
2014-12-08 02:32:43 +01:00 |
|
Dave Halter
|
b24bf29fc2
|
Fixed named argument call signature stuff and issues with classes and call signature params.
|
2014-12-07 23:55:44 +01:00 |
|
Dave Halter
|
bb747a83e8
|
Small fix with big impact for the previously done simple_stmt error recovery. Now it actually works.
|
2014-12-07 19:45:19 +01:00 |
|
Dave Halter
|
2b7434342e
|
Fix absolute imports.
|
2014-12-07 18:51:14 +01:00 |
|
Dave Halter
|
db636c35ae
|
Error recovery should not delete parts of simple_stmt.
|
2014-12-07 18:04:55 +01:00 |
|
Dave Halter
|
b94a09f360
|
Fix end_pos of Literals and Whitespace leafs.
|
2014-12-07 14:28:40 +01:00 |
|
Dave Halter
|
e1e5c3a6c7
|
Progress with call signatures.
|
2014-12-07 13:56:40 +01:00 |
|
Dave Halter
|
b2267d3878
|
Fix usages.
|
2014-12-03 16:34:31 +01:00 |
|
Dave Halter
|
b9e7a2eb95
|
Fix assert issues in combination with comprehensions.
|
2014-12-02 17:55:42 +01:00 |
|
Dave Halter
|
5f89ceb385
|
Add the type attribute to all classes in the tree. Because nodes have them as well.
|
2014-12-02 17:50:55 +01:00 |
|
Dave Halter
|
425741e285
|
Fix assertion/isinstance type information.
|
2014-12-02 17:45:19 +01:00 |
|
Dave Halter
|
3cc4da28ed
|
Fix lambda_nocond.
|
2014-12-01 11:56:28 +01:00 |
|
Dave Halter
|
bcd998ae02
|
Lambdas are own namespaces and deserve their own used_names dictionary in the parser.
|
2014-12-01 11:49:52 +01:00 |
|
Dave Halter
|
88853c78f4
|
Get lambdas mostly working.
|
2014-12-01 02:47:48 +01:00 |
|
Dave Halter
|
68bd9160e2
|
Fixed list comprehension name lookups.
|
2014-12-01 00:08:27 +01:00 |
|
Dave Halter
|
417db4e83f
|
suites without indent can also be deleted.
|
2014-11-29 13:30:21 +01:00 |
|
Dave Halter
|
a7560069b0
|
Fixes for issues with empty compound_stmt. We always remove a whole stmt and just a funcdef as an error correction.
|
2014-11-29 13:25:31 +01:00 |
|
Dave Halter
|
3fb1934462
|
Fix invalid test issues.
|
2014-11-29 01:35:26 +01:00 |
|
Dave Halter
|
2b912cb75a
|
The func/class dictionaries must be changed if some scopes are removed by the parser's error recovery.
|
2014-11-29 01:29:21 +01:00 |
|
Dave Halter
|
43c01afcfc
|
invalid.py test changes. Error recovery will be different from the old one.
|
2014-11-28 21:58:44 +01:00 |
|
Dave Halter
|
2c684906e3
|
Working with dedents in error recovery.
|
2014-11-28 21:33:40 +01:00 |
|
Dave Halter
|
31600b9552
|
classes and functions are new statements and should never get removed by the error recovery.
|
2014-11-28 02:44:34 +01:00 |
|
Dave Halter
|
128dbd34b6
|
Check parentheses level in tokenizer.
|
2014-11-28 02:14:38 +01:00 |
|
Dave Halter
|
e1d6511f2f
|
Trying to move the indent/dedent logic back into the tokenizer.
|
2014-11-28 02:04:04 +01:00 |
|
Dave Halter
|
97516eb26b
|
The new tokenizer is more or less working now. Indents are calculated as they should
|
2014-11-27 16:03:58 +01:00 |
|
Dave Halter
|
c0df7003a5
|
Allow both the old tokenizer and the new one (able to toggle).
|
2014-11-27 01:12:49 +01:00 |
|
Dave Halter
|
c7862925f5
|
Small tokenizer changes & tokens now have a prefix attribute instead of preceeding_whitespace.
|
2014-11-27 01:10:45 +01:00 |
|
Dave Halter
|
cc1098b93c
|
Fix a few tokenize tests and merge them back together.
|
2014-11-26 16:09:28 +01:00 |
|
Dave Halter
|
f43c371467
|
Merge @joel-wright's whitespace tokenizer branch. Thanks!
|
2014-11-26 15:56:11 +01:00 |
|
Dave Halter
|
427056a22d
|
Change the pgen2 parser and its driver so that it can be accessed easily from the outside. This is a minor change and will allow Jedis tokenizer to work with pgen2.
|
2014-11-26 15:38:53 +01:00 |
|
Dave Halter
|
1326a2137d
|
Change the backwards tokenizer that keywords always stop.
|
2014-11-26 02:32:13 +01:00 |
|