Commit Graph

  • 489ea8fc83 Replace set_parser with direct ParserNode instance calls. Dave Halter 2015-02-23 13:10:40 +01:00
  • 2fcb1b9b65 Fast parser fix. Dave Halter 2015-02-23 01:00:17 +01:00
  • 69412224eb Merge pull request #550 from IanLee1521/issue-525 Dave Halter 2015-02-23 00:17:46 +01:00
  • 49150d760e Fixed #525 - Point to readthedocs.org rather than jedidjah.ch #550 Ian Lee 2015-02-22 14:27:38 -08:00
  • 3a5b2d396e Failed statements should not lead to parser fails. Dave Halter 2015-02-22 20:29:22 +01:00
  • 3ec96b25cc Issue with backslashes again in the fast parser. Dave Halter 2015-02-21 18:07:21 +01:00
  • 3347718808 Merge pull request #549 from IanLee1521/readme-update Dave Halter 2015-02-21 10:37:26 +01:00
  • 5625e1cb62 Add self to authors list #549 Ian Lee 2015-02-20 17:17:34 -08:00
  • 2b193cb1f0 Update list of supported cPython versions in readme Ian Lee 2015-02-20 17:13:20 -08:00
  • 0b5a509e83 Small correction: mixed up a re.match and re.search. Dave Halter 2015-02-20 00:48:05 +01:00
  • ce96af5e04 Fix an issue with open parentheses and function definitions right after. The fast parser should behave like the normal one and just ignore the open brackets. Dave Halter 2015-02-19 11:02:11 +01:00
  • 9d048623dd Delete the old and unused MultiLevelStopIteration exception. Dave Halter 2015-02-19 01:43:43 +01:00
  • 0e73bf7d80 Account for code parts that were not parsed in the fast parser. Dave Halter 2015-02-19 01:42:13 +01:00
  • 39bf9f426b Handle backslash escaping. Dave Halter 2015-02-18 17:32:34 +01:00
  • 595da50ab8 The fast parser splitting now also checks for parentheses levels, because without that, sometimes we split in very strange positions, while ignoring others. Dave Halter 2015-02-18 13:48:08 +01:00
  • 38e26892f2 The fast parser doesn't work with open parentheses properly, document that. Dave Halter 2015-02-18 12:50:26 +01:00
  • cefd76e5d1 Testing open parentheses in the fast parser. Dave Halter 2015-02-17 17:23:48 +01:00
  • 506d602795 Fix multi line param issues in the fast parser. Dave Halter 2015-02-17 15:24:49 +01:00
  • 7663703989 Fix issues with multi line for loops in the fast parser. Dave Halter 2015-02-17 14:57:00 +01:00
  • 4d9608ea6f Check more precisely for flow keywords. Dave Halter 2015-02-16 16:04:48 +01:00
  • e1c28d2c3f variables starting with 'class' and 'def' should not slow down the parser, changed the check to 'class ' and 'def '. Dave Halter 2015-02-16 10:07:41 +01:00
  • 3680784234 Add another for in one line test for the fast parser. Dave Halter 2015-02-15 20:28:59 +01:00
  • db31e0e37d The fast parser works now faster in case of for flows with a simple_stmt after. Dave Halter 2015-02-14 18:57:04 +01:00
  • a3b32729a7 Test for an issue with for loops and a statement on the same line. (fast parser) Dave Halter 2015-02-14 16:27:04 +01:00
  • 4613a810a5 Some small refactorings to the names_dict/deep_ast_copy logic. Dave Halter 2015-02-12 13:24:08 +01:00
  • 774b3d5ce8 Python 2 compatibility. Dave Halter 2015-02-12 11:36:36 +01:00
  • a8d3a9ab42 Remove old deep_ast_copy code. Dave Halter 2015-02-12 11:24:17 +01:00
  • bcf6be0636 Radically rewrote deep_ast_copy. Dave Halter 2015-02-12 02:25:54 +01:00
  • a12f259a0f Actually remove check_first from deep_ast_copy. Dave Halter 2015-02-11 14:47:28 +01:00
  • 315c687048 Remove the need for the check_first param in deep_ast_copy. Dave Halter 2015-02-11 14:46:51 +01:00
  • bc722a70f2 Simplify deep_ast_copy. Dave Halter 2015-02-11 02:16:57 +01:00
  • 6e5ba3de87 Fix remaining issue siwh the Param refactoring. Dave Halter 2015-02-11 01:40:18 +01:00
  • cdbe26786a Trying to get ird of the weird param generation in the parser tree. Dave Halter 2015-02-10 15:49:26 +01:00
  • 8775d90173 Merge the master branch into the dev branch. Dave Halter 2015-02-09 14:41:41 +01:00
  • 07156b427c Fix some compatibilty issues in the test suite for Python 2.7. Dave Halter 2015-02-09 14:15:25 +01:00
  • 28d3ba6c04 Fix a test about regex goto, don't know how that one even worked in the first place. Dave Halter 2015-02-09 12:35:20 +01:00
  • a095f8d9e0 Replace some isinstance checks in the parser tree with .type checks. Dave Halter 2015-02-09 12:27:29 +01:00
  • a9a3387cb0 Refactor user scope search. Dave Halter 2015-02-05 21:52:57 +01:00
  • 8125d5f562 Remove asserts and calculate them dynamically. Dave Halter 2015-02-05 20:16:55 +01:00
  • 0a3797cf6e Small refactorings. Dave Halter 2015-02-05 19:47:26 +01:00
  • 2dd08594fc Simplify the indent calculation in the fast parser. Dave Halter 2015-02-05 14:37:24 +01:00
  • abe6c8934c Update the parser pickling protocol version. Dave Halter 2015-02-05 14:19:22 +01:00
  • d0f1fd5267 Rename Simple -> BaseNode. Dave Halter 2015-02-05 14:18:30 +01:00
  • 0c1bbf78e2 Rename SubModule to Module, because that's a more fitting description. There were reasons for the name before the new fast parser, but those don't exist anymore. Dave Halter 2015-02-05 14:16:43 +01:00
  • c689573b0b Removed the line_offset from tokenize, we have better ways to modify positions, now. Dave Halter 2015-02-05 14:00:58 +01:00
  • 59cf1bce5d Delete legacy code from the fast parser. Dave Halter 2015-02-05 13:47:35 +01:00
  • 4ace58e29e Make get_statement_for_position faster. Dave Halter 2015-02-05 13:35:43 +01:00
  • a77ecdbed6 Remove param from get_statement_for_position. Dave Halter 2015-02-05 12:28:55 +01:00
  • 2d9c644ab6 Fixed some minor mocking differences in Python 2 and 3. Dave Halter 2015-02-05 01:25:53 +01:00
  • 109fdc53e0 Fix the remaining fast parser issues. Dave Halter 2015-02-05 01:13:00 +01:00
  • b57ee880af Remove assertEqual from tokenize tests, we can do it with just assert, py.test converts all of that automatically. Dave Halter 2015-02-05 00:48:40 +01:00
  • fdfe17ada5 Import the token IDs directly, this way we minimize lookups. Dave Halter 2015-02-05 00:44:01 +01:00
  • c6b818c504 Changed a tokenize test to match the current intended behavior of the tokenizer. Dave Halter 2015-02-05 00:43:25 +01:00
  • 3a4235eb33 The interpreter is not using the fast parser anymore. Dave Halter 2015-02-05 00:27:37 +01:00
  • dce952aec6 Fix an issue with omited dedents in the parser. Dave Halter 2015-02-05 00:09:16 +01:00
  • e1c623d3f3 Python 2 compatibility. Dave Halter 2015-02-04 17:09:18 +01:00
  • e23e354fe8 Simplified the line splitting and with that a few other things in the fast parser. Dave Halter 2015-02-03 22:22:57 +01:00
  • 66dfa59286 Fix some endmarker prefix issues in the fast parser. Dave Halter 2015-02-03 22:09:55 +01:00
  • 6cdfecb541 Fix a number of issues in the fast parser around functions with only one statement (no suite) and wrong indentations). Dave Halter 2015-02-02 15:03:57 +01:00
  • f9fe6b47eb Fix error statement stacks positions. Dave Halter 2015-02-02 10:43:47 +01:00
  • a4bd412801 Fix an issue with the positions of InstanceNames that used the original position_modifier. Dave Halter 2015-02-02 02:29:39 +01:00
  • c58cdbbf9b Fix an issue that comes from a combination of property/__slots__/pickle Dave Halter 2015-02-02 00:45:17 +01:00
  • e913872192 Merged the tokenize is_identifier changes. Dave Halter 2015-02-01 20:32:01 +01:00
  • 9a0f1363e3 Start removing the print statements that were used for debugging. Dave Halter 2015-02-01 02:32:52 +01:00
  • bc118e8047 Simplify the fast parser tokenizer more. Now it is more readable and less buggy (+bugfixes). Dave Halter 2015-01-31 20:09:44 +01:00
  • 1826f432c8 Fix an issue in the fast parser splitting. Dave Halter 2015-01-30 15:17:38 +01:00
  • 413da3b790 Remove the line_offset calculation. We can now also remove it from tokenize. With the position_modifier we have enough tools to change a position, we don't need to do that in tokenize.py. Dave Halter 2015-01-29 17:57:01 +01:00
  • a3cdec819e Fix the prefix in tokenize, which was the wrong way around. Dave Halter 2015-01-29 17:10:00 +01:00
  • cf1b2ff54b Function tests now pass with the fast parser. Dave Halter 2015-01-29 15:47:38 +01:00
  • a221eee02c Fix more issues in the fast parser. Dave Halter 2015-01-29 15:38:38 +01:00
  • 0a537c05c4 Fix an issue with Function/Flow combination in the fast parser. Dave Halter 2015-01-29 02:24:11 +01:00
  • dde0e9c7c6 Fix for loop issues in the fast parser. Dave Halter 2015-01-29 01:36:16 +01:00
  • e412694fa2 Fix issues with flows in the fast parser. Dave Halter 2015-01-28 17:06:18 +01:00
  • b8c63f366c FastModule seems to be compatible now with the normal Module, because it inherits from it and makes some minor modifications in some cases. Dave Halter 2015-01-28 15:11:21 +01:00
  • c7563470b1 We don't need set_global_names, just set the attribute directly. Dave Halter 2015-01-28 15:00:17 +01:00
  • d0589430bb FastModule should inherit from SubModule, because it has almost all the same properties. Dave Halter 2015-01-28 14:59:00 +01:00
  • 6ec89e6785 Fix issues with flows. Dave Halter 2015-01-28 13:03:57 +01:00
  • 5e8f8f7a8d Fix issues with error correction / newline correction. Dave Halter 2015-01-27 12:24:54 +01:00
  • 62e45aa42b Fix issues with the new newline end_pos positions. Dave Halter 2015-01-27 02:21:05 +01:00
  • 4a07f97f10 Reenable a few get_code tests. Dave Halter 2015-01-27 01:19:09 +01:00
  • 88a3e25814 Fix newline stuff for empty parsers. Dave Halter 2015-01-27 01:15:39 +01:00
  • 39e869d146 Test added newline module end_pos as well. Dave Halter 2015-01-26 22:02:11 +01:00
  • cdae250b36 code -> source and also care for added newlines in the fast parser. Dave Halter 2015-01-26 22:01:39 +01:00
  • 07c60d7ff6 Fix DEDENT issues in _remove_newline. Dave Halter 2015-01-26 21:17:50 +01:00
  • 61e2bba380 Tests and implementation to remove the last newline again in the parser tree, to be able to exactly reproduce the parser input. Dave Halter 2015-01-26 21:07:14 +01:00
  • e5d265e845 Add a method Leaf.get_previous, to get previous leafs. Dave Halter 2015-01-26 21:02:27 +01:00
  • 8621aae73c Add any .egg-link paths from VIRTUAL_ENV to sys.path #534 Daniel Hahler 2015-01-19 16:31:15 +01:00
  • a8943b8a80 Get the position modifiers right. Dave Halter 2015-01-24 20:42:28 +01:00
  • 446f5b9018 Fix issues with the right count of parsers used. Dave Halter 2015-01-24 20:19:03 +01:00
  • 4d6afd3c99 Fix fast parser tests. Dave Halter 2015-01-24 00:06:16 +01:00
  • 8569651bf4 Fast parser simplifications and bug fixes. Dave Halter 2015-01-21 18:34:22 +01:00
  • 91ab1d0ecd Fix an issue in the fast parser that caused stuff to be parsed always. Dave Halter 2015-01-21 02:03:06 +01:00
  • 7188105dc7 The fast parser is now in a more readable shape. Dave Halter 2015-01-19 16:21:25 +01:00
  • ce793b1066 Trying to restructure the fast parser. Dave Halter 2015-01-19 14:49:44 +01:00
  • d6b3b76d26 First fast parser version that actually let a test pass. Dave Halter 2015-01-19 00:39:51 +01:00
  • add0cafbf1 Merge pull request #530 from felipeacsi/arch-installation Dave Halter 2015-01-17 13:50:49 +01:00
  • f348aaeab6 Updated Arch Linux installation #530 felipeacsi 2015-01-16 14:38:39 -03:00
  • 01c209dc00 MergedNamesDicts for the parser. Dave Halter 2015-01-16 15:25:58 +01:00
  • e477fab856 Playing with the fast parser implementation. Dave Halter 2015-01-16 15:23:49 +01:00
  • 86391268a7 Merge pull request #528 from KenetJervet/parser Dave Halter 2015-01-16 13:03:56 +01:00