Dave Halter
|
e1c28d2c3f
|
variables starting with 'class' and 'def' should not slow down the parser, changed the check to 'class ' and 'def '.
|
2015-02-16 10:08:22 +01:00 |
|
Dave Halter
|
db31e0e37d
|
The fast parser works now faster in case of for flows with a simple_stmt after.
|
2015-02-14 18:57:04 +01:00 |
|
Dave Halter
|
4613a810a5
|
Some small refactorings to the names_dict/deep_ast_copy logic.
|
2015-02-12 13:24:08 +01:00 |
|
Dave Halter
|
774b3d5ce8
|
Python 2 compatibility.
|
2015-02-12 11:36:36 +01:00 |
|
Dave Halter
|
a8d3a9ab42
|
Remove old deep_ast_copy code.
|
2015-02-12 11:24:17 +01:00 |
|
Dave Halter
|
6e5ba3de87
|
Fix remaining issue siwh the Param refactoring.
|
2015-02-11 01:40:18 +01:00 |
|
Dave Halter
|
cdbe26786a
|
Trying to get ird of the weird param generation in the parser tree.
|
2015-02-10 15:49:26 +01:00 |
|
Dave Halter
|
a095f8d9e0
|
Replace some isinstance checks in the parser tree with .type checks.
|
2015-02-09 12:27:29 +01:00 |
|
Dave Halter
|
a9a3387cb0
|
Refactor user scope search.
|
2015-02-05 21:52:57 +01:00 |
|
Dave Halter
|
8125d5f562
|
Remove asserts and calculate them dynamically.
|
2015-02-05 20:16:55 +01:00 |
|
Dave Halter
|
2dd08594fc
|
Simplify the indent calculation in the fast parser.
|
2015-02-05 14:37:24 +01:00 |
|
Dave Halter
|
d0f1fd5267
|
Rename Simple -> BaseNode.
|
2015-02-05 14:18:30 +01:00 |
|
Dave Halter
|
0c1bbf78e2
|
Rename SubModule to Module, because that's a more fitting description. There were reasons for the name before the new fast parser, but those don't exist anymore.
|
2015-02-05 14:16:43 +01:00 |
|
Dave Halter
|
c689573b0b
|
Removed the line_offset from tokenize, we have better ways to modify positions, now.
|
2015-02-05 14:00:58 +01:00 |
|
Dave Halter
|
59cf1bce5d
|
Delete legacy code from the fast parser.
|
2015-02-05 13:47:35 +01:00 |
|
Dave Halter
|
4ace58e29e
|
Make get_statement_for_position faster.
|
2015-02-05 13:35:43 +01:00 |
|
Dave Halter
|
a77ecdbed6
|
Remove param from get_statement_for_position.
|
2015-02-05 12:28:55 +01:00 |
|
Dave Halter
|
109fdc53e0
|
Fix the remaining fast parser issues.
|
2015-02-05 01:13:00 +01:00 |
|
Dave Halter
|
fdfe17ada5
|
Import the token IDs directly, this way we minimize lookups.
|
2015-02-05 00:44:01 +01:00 |
|
Dave Halter
|
3a4235eb33
|
The interpreter is not using the fast parser anymore.
|
2015-02-05 00:28:54 +01:00 |
|
Dave Halter
|
dce952aec6
|
Fix an issue with omited dedents in the parser.
|
2015-02-05 00:11:12 +01:00 |
|
Dave Halter
|
e1c623d3f3
|
Python 2 compatibility.
|
2015-02-04 17:09:18 +01:00 |
|
Dave Halter
|
e23e354fe8
|
Simplified the line splitting and with that a few other things in the fast parser.
|
2015-02-03 22:22:57 +01:00 |
|
Dave Halter
|
66dfa59286
|
Fix some endmarker prefix issues in the fast parser.
|
2015-02-03 22:09:55 +01:00 |
|
Dave Halter
|
6cdfecb541
|
Fix a number of issues in the fast parser around functions with only one statement (no suite) and wrong indentations).
|
2015-02-02 15:03:57 +01:00 |
|
Dave Halter
|
f9fe6b47eb
|
Fix error statement stacks positions.
|
2015-02-02 10:43:47 +01:00 |
|
Dave Halter
|
a4bd412801
|
Fix an issue with the positions of InstanceNames that used the original position_modifier.
|
2015-02-02 02:29:39 +01:00 |
|
Dave Halter
|
c58cdbbf9b
|
Fix an issue that comes from a combination of property/__slots__/pickle
|
2015-02-02 00:45:17 +01:00 |
|
Dave Halter
|
e913872192
|
Merged the tokenize is_identifier changes.
|
2015-02-01 20:32:01 +01:00 |
|
Dave Halter
|
9a0f1363e3
|
Start removing the print statements that were used for debugging.
|
2015-02-01 02:32:52 +01:00 |
|
Dave Halter
|
bc118e8047
|
Simplify the fast parser tokenizer more. Now it is more readable and less buggy (+bugfixes).
|
2015-01-31 20:09:44 +01:00 |
|
Dave Halter
|
1826f432c8
|
Fix an issue in the fast parser splitting.
|
2015-01-30 15:17:38 +01:00 |
|
Dave Halter
|
413da3b790
|
Remove the line_offset calculation. We can now also remove it from tokenize. With the position_modifier we have enough tools to change a position, we don't need to do that in tokenize.py.
|
2015-01-29 17:57:01 +01:00 |
|
Dave Halter
|
a3cdec819e
|
Fix the prefix in tokenize, which was the wrong way around.
|
2015-01-29 17:10:00 +01:00 |
|
Dave Halter
|
cf1b2ff54b
|
Function tests now pass with the fast parser.
|
2015-01-29 15:47:38 +01:00 |
|
Dave Halter
|
a221eee02c
|
Fix more issues in the fast parser.
|
2015-01-29 15:38:38 +01:00 |
|
Dave Halter
|
0a537c05c4
|
Fix an issue with Function/Flow combination in the fast parser.
|
2015-01-29 02:24:11 +01:00 |
|
Dave Halter
|
dde0e9c7c6
|
Fix for loop issues in the fast parser.
|
2015-01-29 01:36:16 +01:00 |
|
Dave Halter
|
e412694fa2
|
Fix issues with flows in the fast parser.
|
2015-01-28 17:06:18 +01:00 |
|
Dave Halter
|
b8c63f366c
|
FastModule seems to be compatible now with the normal Module, because it inherits from it and makes some minor modifications in some cases.
|
2015-01-28 15:11:53 +01:00 |
|
Dave Halter
|
c7563470b1
|
We don't need set_global_names, just set the attribute directly.
|
2015-01-28 15:00:17 +01:00 |
|
Dave Halter
|
d0589430bb
|
FastModule should inherit from SubModule, because it has almost all the same properties.
|
2015-01-28 14:59:00 +01:00 |
|
Dave Halter
|
6ec89e6785
|
Fix issues with flows.
|
2015-01-28 13:03:57 +01:00 |
|
Dave Halter
|
5e8f8f7a8d
|
Fix issues with error correction / newline correction.
|
2015-01-27 12:24:54 +01:00 |
|
Dave Halter
|
62e45aa42b
|
Fix issues with the new newline end_pos positions.
|
2015-01-27 02:21:05 +01:00 |
|
Dave Halter
|
88a3e25814
|
Fix newline stuff for empty parsers.
|
2015-01-27 01:15:39 +01:00 |
|
Dave Halter
|
39e869d146
|
Test added newline module end_pos as well.
|
2015-01-26 22:02:11 +01:00 |
|
Dave Halter
|
cdae250b36
|
code -> source and also care for added newlines in the fast parser.
|
2015-01-26 22:01:39 +01:00 |
|
Dave Halter
|
07c60d7ff6
|
Fix DEDENT issues in _remove_newline.
|
2015-01-26 21:17:50 +01:00 |
|
Dave Halter
|
61e2bba380
|
Tests and implementation to remove the last newline again in the parser tree, to be able to exactly reproduce the parser input.
|
2015-01-26 21:07:14 +01:00 |
|