 Dave Halter
|
43c01afcfc
|
invalid.py test changes. Error recovery will be different from the old one.
|
2014-11-28 21:58:44 +01:00 |
|
|
Dave Halter
|
2c684906e3
|
Working with dedents in error recovery.
|
2014-11-28 21:33:40 +01:00 |
|
|
Dave Halter
|
31600b9552
|
classes and functions are new statements and should never get removed by the error recovery.
|
2014-11-28 02:44:34 +01:00 |
|
|
Dave Halter
|
128dbd34b6
|
Check parentheses level in tokenizer.
|
2014-11-28 02:14:38 +01:00 |
|
|
Dave Halter
|
e1d6511f2f
|
Trying to move the indent/dedent logic back into the tokenizer.
|
2014-11-28 02:04:04 +01:00 |
|
|
Dave Halter
|
97516eb26b
|
The new tokenizer is more or less working now. Indents are calculated as they should
|
2014-11-27 16:03:58 +01:00 |
|
|
Dave Halter
|
c0df7003a5
|
Allow both the old tokenizer and the new one (able to toggle).
|
2014-11-27 01:12:49 +01:00 |
|
|
Dave Halter
|
c7862925f5
|
Small tokenizer changes & tokens now have a prefix attribute instead of preceeding_whitespace.
|
2014-11-27 01:10:45 +01:00 |
|
|
Dave Halter
|
cc1098b93c
|
Fix a few tokenize tests and merge them back together.
|
2014-11-26 16:09:28 +01:00 |
|
|
Dave Halter
|
f43c371467
|
Merge @joel-wright's whitespace tokenizer branch. Thanks!
|
2014-11-26 15:56:11 +01:00 |
|
|
Dave Halter
|
427056a22d
|
Change the pgen2 parser and its driver so that it can be accessed easily from the outside. This is a minor change and will allow Jedis tokenizer to work with pgen2.
|
2014-11-26 15:38:53 +01:00 |
|
|
Dave Halter
|
1326a2137d
|
Change the backwards tokenizer that keywords always stop.
|
2014-11-26 02:32:13 +01:00 |
|
|
Dave Halter
|
5d82b11f59
|
First implementation to be ready to complete corrupt imports. Working ok.
|
2014-11-25 19:35:27 +01:00 |
|
|
Dave Halter
|
e72eaf7a59
|
on import completion preparations.
|
2014-11-25 15:10:36 +01:00 |
|
|
Dave Halter
|
db76bbccc5
|
Trying to change the symbols in node. They are now strings.
With this change we are finally able to get rid of parser/pytree.py
|
2014-11-24 01:52:41 +01:00 |
|
|
Dave Halter
|
9f45f18ad1
|
Added a grammar param to the parser.
|
2014-11-24 01:10:39 +01:00 |
|
|
Dave Halter
|
c152a1c58b
|
Actually replace tree with representation (in all the imports).
|
2014-11-23 19:46:52 +01:00 |
|
|
Dave Halter
|
1fbc4c9196
|
Change parser.representation to parser.tree. It's shorter and says more.
|
2014-11-23 19:35:46 +01:00 |
|
|
Dave Halter
|
ac41c31015
|
Removed more of the old parser representation code.
|
2014-11-23 19:33:18 +01:00 |
|
|
Dave Halter
|
9b54541cae
|
Remove quite a bit of the old parser representation logic.
|
2014-11-23 19:26:30 +01:00 |
|
|
Dave Halter
|
0f21d38e2c
|
Remove the old parser.
|
2014-11-23 19:17:50 +01:00 |
|
|
Dave Halter
|
f1cbd45575
|
Usages are pretty solid now except for parser issues.
|
2014-11-22 15:43:23 +01:00 |
|
|
Dave Halter
|
b82e1e28e5
|
Get at least some usages stuff right.
|
2014-11-22 02:05:36 +01:00 |
|
|
Dave Halter
|
22fbcf6c77
|
More goto improvements.
|
2014-11-21 15:45:17 +01:00 |
|
|
Dave Halter
|
eb0bfb4381
|
get_code in Definition.description should not return first prefix.
|
2014-11-21 15:33:38 +01:00 |
|
|
Dave Halter
|
83b09f6c1e
|
Small issue with is_definition and params. Found by looking at stdlib/random.choice tests.
|
2014-11-20 14:48:34 +01:00 |
|
|
Dave Halter
|
2c3a7b6d6c
|
Imports are not Statements.
|
2014-11-20 02:29:24 +01:00 |
|
|
Dave Halter
|
164518b993
|
Get docstrings working.
|
2014-11-20 02:19:01 +01:00 |
|
|
Dave Halter
|
ce5d428d22
|
At least functions generate docstrings again.
|
2014-11-20 01:37:18 +01:00 |
|
|
Dave Halter
|
ba0e61d99f
|
Star imports are now part of the ModuleWrapper.
|
2014-11-19 18:09:49 +01:00 |
|
|
Dave Halter
|
08bdcfb8ca
|
Small issue with relative imports that don't contain a path after from.
|
2014-11-19 15:22:18 +01:00 |
|
|
Dave Halter
|
bb9d6b4832
|
Temporarily disable on import completion. Not sure if we're going to do it with the normal parser.
|
2014-11-19 13:24:45 +01:00 |
|
|
Dave Halter
|
c71646a9a0
|
Fixed relative imports.
|
2014-11-19 13:13:06 +01:00 |
|
|
Dave Halter
|
6c5f3419ff
|
'as' test and implementation for ImportName. Working pretty well.
|
2014-11-19 13:07:08 +01:00 |
|
|
Dave Halter
|
e630eeb397
|
Care for import aliases better.
|
2014-11-19 12:45:39 +01:00 |
|
|
Dave Halter
|
1c240e75d3
|
Replace get_all_import_names with a leaf search method in Simple.
|
2014-11-19 01:31:08 +01:00 |
|
|
Dave Halter
|
bab6788b42
|
split and improved Import*._paths
|
2014-11-19 00:45:20 +01:00 |
|
|
Dave Halter
|
3c6d5dafb1
|
Split Import, now there is ImportFrom and ImportName as it exists in the python grammar.
|
2014-11-19 00:40:16 +01:00 |
|
|
Dave Halter
|
535a69e499
|
Small improvments to from imports
|
2014-11-18 18:43:16 +01:00 |
|
|
Dave Halter
|
9d5f3162d7
|
More import stuff. Fake imports work a little bit better.
|
2014-11-18 18:22:26 +01:00 |
|
|
Dave Halter
|
a4a767f8bb
|
Import improvements.
|
2014-11-18 17:19:15 +01:00 |
|
|
Dave Halter
|
4fa78e3482
|
Fix the last remaining issue with decorators.
|
2014-11-17 23:59:38 +01:00 |
|
|
Dave Halter
|
fd8752f285
|
Now most decorator tests pass.
|
2014-11-17 23:46:05 +01:00 |
|
|
Dave Halter
|
f62f181066
|
First decorator implementations.
|
2014-11-17 22:24:54 +01:00 |
|
|
Dave Halter
|
13a128b160
|
global working.
|
2014-11-13 18:13:56 +01:00 |
|
|
Dave Halter
|
f3c2b4fc33
|
Get with statements working.
|
2014-11-13 12:51:49 +01:00 |
|
|
Dave Halter
|
541b8872d0
|
Changed is_node so it can actually deal with InstanceElements.
|
2014-11-13 01:15:44 +01:00 |
|
|
Dave Halter
|
1ab67ebbba
|
Fix except statements names.
|
2014-11-13 01:02:56 +01:00 |
|
|
Dave Halter
|
408eee50dd
|
Start fixing issues with for loops and += operations.
|
2014-11-12 14:54:52 +01:00 |
|
|
Dave Halter
|
cc661473bc
|
Trying to change used_names, so that they don't contain name definitions from CompFor.
|
2014-11-11 17:13:27 +01:00 |
|