Dave Halter
|
2c684906e3
|
Working with dedents in error recovery.
|
2014-11-28 21:33:40 +01:00 |
|
Dave Halter
|
31600b9552
|
classes and functions are new statements and should never get removed by the error recovery.
|
2014-11-28 02:44:34 +01:00 |
|
Dave Halter
|
e1d6511f2f
|
Trying to move the indent/dedent logic back into the tokenizer.
|
2014-11-28 02:04:04 +01:00 |
|
Dave Halter
|
97516eb26b
|
The new tokenizer is more or less working now. Indents are calculated as they should
|
2014-11-27 16:03:58 +01:00 |
|
Dave Halter
|
427056a22d
|
Change the pgen2 parser and its driver so that it can be accessed easily from the outside. This is a minor change and will allow Jedis tokenizer to work with pgen2.
|
2014-11-26 15:38:53 +01:00 |
|
Dave Halter
|
5d82b11f59
|
First implementation to be ready to complete corrupt imports. Working ok.
|
2014-11-25 19:35:27 +01:00 |
|
Dave Halter
|
9549c2b389
|
Last few small changes to the parser. Now beginning to work on the tests again.
|
2014-11-05 17:39:56 +01:00 |
|
Dave Halter
|
70bc6642d8
|
symbols on the stack are now defined with a smaller tuple.
|
2014-11-05 10:27:24 +01:00 |
|
Dave Halter
|
da5dd0efa1
|
simplify the parser stack.
|
2014-11-05 00:35:58 +01:00 |
|
Dave Halter
|
61df804e6e
|
context is not needed for nodes.
|
2014-11-04 19:49:39 +01:00 |
|
Dave Halter
|
3b4a8dcd7e
|
convert: run away from tuples.
|
2014-11-04 19:26:33 +01:00 |
|
Dave Halter
|
3518123afa
|
Moved the convert function away from pytree
|
2014-11-04 19:09:58 +01:00 |
|
Dave Halter
|
f3e4bf9ed1
|
Splitting up the convert function into leaves and nodes.
|
2014-11-04 18:54:25 +01:00 |
|
Dave Halter
|
d483d50284
|
Small optimizations to make parsing faster.
|
2014-11-04 17:23:16 +01:00 |
|
Dave Halter
|
1ff4713848
|
Move error recovery function.
|
2014-11-02 17:24:06 +01:00 |
|
Dave Halter
|
1bb0eccc86
|
Simple error recovery in the parser: For now just discard everything that is not a suite or file_input, if we detect an error.
|
2014-10-30 01:40:22 +01:00 |
|
Dave Halter
|
e9f4c60e49
|
Use used_names not in pgen2, but only in our parser.
|
2014-10-22 15:50:02 +02:00 |
|
Dave Halter
|
fb2ef5a7a0
|
Start using arrays.
|
2014-10-21 11:05:12 +02:00 |
|
Dave Halter
|
718f43431c
|
Introduce error recovery for the parser: At the moment just recover from broken statements.
|
2014-10-21 09:57:22 +02:00 |
|
Dave Halter
|
834172a3e9
|
Add a new parser, check it pgen2 would work. (already modified outside this repository)
|
2014-10-08 14:26:52 +02:00 |
|