Commit Graph

4230 Commits

Author SHA1 Message Date
Dave Halter 30efdc5e4e Because we replaced and simplified strings in the last commits (including string ERRORTOKENs), we are now able to remove an error recovery in the backwards tokenizer. 2015-02-25 13:34:12 +01:00
Dave Halter 8c08a4e574 Call signatures again: function definitions and other things that cannot be a part of call signatures stop the process of scanning for them. Also strings get replaced and simplified. 2015-02-25 13:33:09 +01:00
Dave Halter 48392a7dac Fix some issues in call signatures. 2015-02-24 16:55:33 +01:00
Dave Halter b8386d29d5 Whitespace before brackets should still show call signatures. 2015-02-24 01:48:25 +01:00
Dave Halter 0ae74a7666 Replace a __bases__ call with an __mro__ call, because the latter is closer to how Python actually works. __bases__ is never used. 2015-02-23 19:07:23 +01:00
Dave Halter 4f2d4992da Fix an mro resolution issue. 2015-02-23 19:04:35 +01:00
Dave Halter a91e240c8b ALWAYS_BREAK_TOKEN -> ALWAYS_BREAK_TOKENS 2015-02-23 14:10:29 +01:00
Dave Halter aebeafccc4 Rewrite last newlines in the fast parser to get correct get_code outputs even with the fast parser. 2015-02-23 13:36:43 +01:00
Dave Halter 489ea8fc83 Replace set_parser with direct ParserNode instance calls. 2015-02-23 13:10:40 +01:00
Dave Halter 2fcb1b9b65 Fast parser fix. 2015-02-23 01:00:17 +01:00
Dave Halter 69412224eb Merge pull request #550 from IanLee1521/issue-525
Point docs at readthedocs.org rather than jedidjah.ch
2015-02-23 00:17:46 +01:00
Ian Lee 49150d760e Fixed #525 - Point to readthedocs.org rather than jedidjah.ch 2015-02-22 14:29:31 -08:00
Dave Halter 3a5b2d396e Failed statements should not lead to parser fails. 2015-02-22 20:29:22 +01:00
Dave Halter 3ec96b25cc Issue with backslashes again in the fast parser. 2015-02-21 18:07:21 +01:00
Dave Halter 3347718808 Merge pull request #549 from IanLee1521/readme-update
Readme update
2015-02-21 10:37:26 +01:00
Ian Lee 5625e1cb62 Add self to authors list 2015-02-20 17:17:34 -08:00
Ian Lee 2b193cb1f0 Update list of supported cPython versions in readme 2015-02-20 17:14:00 -08:00
Dave Halter 0b5a509e83 Small correction: mixed up a re.match and re.search. 2015-02-20 00:48:05 +01:00
Dave Halter ce96af5e04 Fix an issue with open parentheses and function definitions right after. The fast parser should behave like the normal one and just ignore the open brackets. 2015-02-19 11:02:11 +01:00
Dave Halter 9d048623dd Delete the old and unused MultiLevelStopIteration exception. 2015-02-19 01:43:43 +01:00
Dave Halter 0e73bf7d80 Account for code parts that were not parsed in the fast parser. 2015-02-19 01:42:13 +01:00
Dave Halter 39bf9f426b Handle backslash escaping. 2015-02-18 17:32:34 +01:00
Dave Halter 595da50ab8 The fast parser splitting now also checks for parentheses levels, because without that, sometimes we split in very strange positions, while ignoring others. 2015-02-18 13:49:03 +01:00
Dave Halter 38e26892f2 The fast parser doesn't work with open parentheses properly, document that. 2015-02-18 12:50:26 +01:00
Dave Halter cefd76e5d1 Testing open parentheses in the fast parser. 2015-02-17 17:26:00 +01:00
Dave Halter 506d602795 Fix multi line param issues in the fast parser. 2015-02-17 15:24:49 +01:00
Dave Halter 7663703989 Fix issues with multi line for loops in the fast parser. 2015-02-17 14:57:00 +01:00
Dave Halter 4d9608ea6f Check more precisely for flow keywords. 2015-02-16 16:04:48 +01:00
Dave Halter e1c28d2c3f variables starting with 'class' and 'def' should not slow down the parser, changed the check to 'class ' and 'def '. 2015-02-16 10:08:22 +01:00
Dave Halter 3680784234 Add another for in one line test for the fast parser. 2015-02-15 20:28:59 +01:00
Dave Halter db31e0e37d The fast parser works now faster in case of for flows with a simple_stmt after. 2015-02-14 18:57:04 +01:00
Dave Halter a3b32729a7 Test for an issue with for loops and a statement on the same line. (fast parser) 2015-02-14 16:27:04 +01:00
Dave Halter 4613a810a5 Some small refactorings to the names_dict/deep_ast_copy logic. 2015-02-12 13:24:08 +01:00
Dave Halter 774b3d5ce8 Python 2 compatibility. 2015-02-12 11:36:36 +01:00
Dave Halter a8d3a9ab42 Remove old deep_ast_copy code. 2015-02-12 11:24:17 +01:00
Dave Halter bcf6be0636 Radically rewrote deep_ast_copy. 2015-02-12 02:25:54 +01:00
Dave Halter a12f259a0f Actually remove check_first from deep_ast_copy. 2015-02-11 14:47:28 +01:00
Dave Halter 315c687048 Remove the need for the check_first param in deep_ast_copy. 2015-02-11 14:46:51 +01:00
Dave Halter bc722a70f2 Simplify deep_ast_copy. 2015-02-11 02:16:57 +01:00
Dave Halter 6e5ba3de87 Fix remaining issue siwh the Param refactoring. 2015-02-11 01:40:18 +01:00
Dave Halter cdbe26786a Trying to get ird of the weird param generation in the parser tree. 2015-02-10 15:49:26 +01:00
Dave Halter 8775d90173 Merge the master branch into the dev branch. 2015-02-09 14:41:41 +01:00
Dave Halter 07156b427c Fix some compatibilty issues in the test suite for Python 2.7. 2015-02-09 14:15:25 +01:00
Dave Halter 28d3ba6c04 Fix a test about regex goto, don't know how that one even worked in the first place. 2015-02-09 12:35:20 +01:00
Dave Halter a095f8d9e0 Replace some isinstance checks in the parser tree with .type checks. 2015-02-09 12:27:29 +01:00
Dave Halter a9a3387cb0 Refactor user scope search. 2015-02-05 21:52:57 +01:00
Dave Halter 8125d5f562 Remove asserts and calculate them dynamically. 2015-02-05 20:16:55 +01:00
Dave Halter 0a3797cf6e Small refactorings. 2015-02-05 19:47:26 +01:00
Dave Halter 2dd08594fc Simplify the indent calculation in the fast parser. 2015-02-05 14:37:24 +01:00
Dave Halter abe6c8934c Update the parser pickling protocol version. 2015-02-05 14:19:22 +01:00