Commit Graph

  • 0daf4d9068 Asterisks in function definitions may be at the end of a func without a comma, fixes #44 Dave Halter 2018-07-04 09:51:34 +02:00
  • 29b6232541 Remove some TODOs that were fixed Dave Halter 2018-07-03 19:28:05 +02:00
  • e05d7fd59f Error recovery should not match the whole line in case of an invalid token, fixes #40 Dave Halter 2018-07-03 01:31:02 +02:00
  • 7f964c26f2 docs: enable searchbox Daniel Hahler 2018-07-01 21:53:01 +02:00
  • ff67de248f Merge branch 'pgen' v0.3.0 Dave Halter 2018-06-29 18:14:03 +02:00
  • 1af5d9d46b Add a changelog for 0.3.0 Dave Halter 2018-06-29 18:13:53 +02:00
  • fce3ead829 Bump version to 0.3.0 Dave Halter 2018-06-29 18:04:55 +02:00
  • 55d5d39c53 Add a private API for jedi to work with the parser stack Dave Halter 2018-06-29 10:04:54 +02:00
  • c8bf23b787 Remove get_tos_nodes and get_tos_first_tokens, because they are not used (not even in Jedi) Dave Halter 2018-06-29 00:00:09 +02:00
  • 98c9a1ec7f Better documentation for _add_token Dave Halter 2018-06-28 10:11:44 +02:00
  • ecdb90d9bc Way better documentation for the DFA generator Dave Halter 2018-06-28 10:08:09 +02:00
  • 375ebf2181 Better documentation of the parser generator Dave Halter 2018-06-28 09:49:35 +02:00
  • badb2fe010 Move transition_to_generator to transitions Dave Halter 2018-06-28 09:42:37 +02:00
  • 8e118c913c Remove note about print as absolute import. This is probably not going to happen anymore, Python 2 is pretty much end-of-life Dave Halter 2018-06-28 01:01:46 +02:00
  • 52fc8fc569 Finish the stack in a way we want to. Dave Halter 2018-06-28 00:59:55 +02:00
  • 97cdb448d4 Pass tokens around and not all the different token values Dave Halter 2018-06-28 00:33:22 +02:00
  • 603b67ee6d Just always pass token objects to the tokenizer Dave Halter 2018-06-28 00:18:44 +02:00
  • 7686273287 Use the stack from the parser itself Dave Halter 2018-06-28 00:12:18 +02:00
  • 692436ba12 Don't use grammar as an argument anymore, because it's already there Dave Halter 2018-06-28 00:01:47 +02:00
  • f7d3d4e82f Merge the PgenParser and our own parser Dave Halter 2018-06-27 23:45:04 +02:00
  • edce279dee Remove a function that was no longer used Dave Halter 2018-06-27 23:19:57 +02:00
  • a9e40eb578 Simplify error recovery for suites Dave Halter 2018-06-27 22:21:17 +02:00
  • b14f518306 Rename the last usage of ilabel to transition Dave Halter 2018-06-27 00:18:27 +02:00
  • 8407894b25 Fix python 2 tests Dave Halter 2018-06-27 00:15:00 +02:00
  • e4efebc9f3 s/ilabel/transition/g Dave Halter 2018-06-26 23:05:04 +02:00
  • f66e47c540 Check better for more transitions Dave Halter 2018-06-26 22:53:02 +02:00
  • 706a92ee0d Merge branch 'master' of github.com:davidhalter/parso Dave Halter 2018-06-26 10:23:17 +02:00
  • 91d864b23d Make it clearer which things are public in pgen Dave Halter 2018-06-26 10:22:38 +02:00
  • e20f2069ba Move the grammar to a fitting file. Dave Halter 2018-06-26 10:20:05 +02:00
  • 4cf198285a Move things out of the grammar class Dave Halter 2018-06-26 10:15:31 +02:00
  • 30cf491b4f Move the Grammar to the pgen module Dave Halter 2018-06-26 10:08:44 +02:00
  • c1675da0cb Make nonterminal_to_dfas public Dave Halter 2018-06-26 09:56:49 +02:00
  • 7b7b66eb3c Get rid of the first_terminal variable in the grammar generator Dave Halter 2018-06-26 09:48:13 +02:00
  • 5d46c3e18b Trying to reduce the amount of variables used in first sets Dave Halter 2018-06-26 01:04:22 +02:00
  • e9fde82512 Remove the overlapcheck, it's probably not needed anymore Dave Halter 2018-06-26 01:00:06 +02:00
  • a46ecbb499 Fix an ambiguity issue Dave Halter 2018-06-26 00:58:19 +02:00
  • da5aa8a2ab Better detection of ambiguities Dave Halter 2018-06-25 01:56:02 +02:00
  • 43d4a8a834 Don't use a function that doesn't work Dave Halter 2018-06-24 23:45:18 +02:00
  • 309033ae2d Work with token types whenever possible Dave Halter 2018-06-24 17:59:32 +02:00
  • 2a9d8632fe Remove label caching Dave Halter 2018-06-24 17:56:13 +02:00
  • 530a324643 Remove labels Dave Halter 2018-06-24 17:55:22 +02:00
  • 71003bc20e Just use caching instead of strange transitions Dave Halter 2018-06-24 17:29:03 +02:00
  • c5d141bf60 Make some more things faster Dave Halter 2018-06-24 16:43:01 +02:00
  • e958b241c7 Use some tokenize names directly Dave Halter 2018-06-24 16:39:48 +02:00
  • 34ab35558f Remove a lot of the old token code Dave Halter 2018-06-24 16:31:58 +02:00
  • 03de9cebb8 Introduce TokenTypes Dave Halter 2018-06-24 16:24:09 +02:00
  • 6098d89150 Add PythonTokens to get rid of a lot of the token module eventually Dave Halter 2018-06-24 13:03:07 +02:00
  • ff4358cd97 Merge remote-tracking branch 'origin/master' into pgen Dave Halter 2018-06-24 11:49:34 +02:00
  • b5378e4602 Use token.OP and use reserved words Dave Halter 2018-06-24 11:28:23 +02:00
  • 33e321a539 Don't set the root node before it's not actually defined Dave Halter 2018-06-22 13:04:00 +02:00
  • a890ddd6cc Remove make_first Dave Halter 2018-06-22 12:54:27 +02:00
  • 1362d4f05d Remove more unused grammar stuff Dave Halter 2018-06-22 12:53:38 +02:00
  • 532aef2342 Remove nonterminal2number and number2nonterminal, they are no longer used Dave Halter 2018-06-22 12:52:44 +02:00
  • 878b4b2d3b Use nonterminals instead of numbers if possible Dave Halter 2018-06-22 12:47:02 +02:00
  • 87299335c4 Remove more unused code Dave Halter 2018-06-22 12:36:48 +02:00
  • 4f0e9c0fd7 Remove old dfas and states from the parser generator Dave Halter 2018-06-22 11:47:18 +02:00
  • 67ca091631 delete a lot of the old parser code Dave Halter 2018-06-22 11:44:42 +02:00
  • 4e5ba02dbb Fix the final issues of the new parser Dave Halter 2018-06-22 11:38:34 +02:00
  • a85f544901 Fix all tests except diff tests. Mostly error recovery fixes Dave Halter 2018-06-22 11:12:10 +02:00
  • 9e8066c6fd Fix a lot of the old error recovery Dave Halter 2018-06-22 09:56:58 +02:00
  • 68eab72229 Some slight changes to error recovery Dave Halter 2018-06-22 01:59:39 +02:00
  • d9264609f2 Get quite a bit of the error recovery working Dave Halter 2018-06-22 01:56:29 +02:00
  • 79c7e0b59d Use the new parser. Error recovery is not yet working Dave Halter 2018-06-22 00:38:18 +02:00
  • f03a87b876 Actually parse some first things with the new approach Dave Halter 2018-06-21 23:56:34 +02:00
  • 2a082d69df Add better reprs Dave Halter 2018-06-21 22:12:26 +02:00
  • e6fc739670 Get most things ready for plans Dave Halter 2018-06-21 21:32:05 +02:00
  • 12e11b3d16 Remove a while loop that is not necessary Dave Halter 2018-06-21 21:14:14 +02:00
  • cc8038966b isfinal -> is_final Dave Halter 2018-06-21 21:11:46 +02:00
  • 31aecf2d35 Calculate the first plans in a very messy way Dave Halter 2018-06-21 21:10:28 +02:00
  • d8554d86d1 A lot of new code to hopefully transition to a better parsing mechanism in the future Dave Halter 2018-06-21 18:17:32 +02:00
  • d691bf0fd1 Some minor changes Dave Halter 2018-06-20 09:42:21 +02:00
  • 5712ffb5ca Introduce a label cache that is currently not used Dave Halter 2018-06-18 20:14:29 +02:00
  • 55d6a69aad Some more renames Dave Halter 2018-06-18 01:14:09 +02:00
  • 453471eeb6 Move some ParserGenerator stuff into the Grammar class Dave Halter 2018-06-18 00:15:21 +02:00
  • a06c3a3129 name -> nonterminal Dave Halter 2018-06-17 23:10:27 +02:00
  • 73ce57428b Try to completely remove the word symbol and use nonterminal Dave Halter 2018-06-17 18:30:20 +02:00
  • 640f544af9 One instance of symbol -> terminal Dave Halter 2018-06-17 18:12:13 +02:00
  • b6cbf306d7 Use the name first_terminals instead of first Dave Halter 2018-06-17 18:09:12 +02:00
  • 95e4ecf592 next -> next_ Dave Halter 2018-06-17 17:49:43 +02:00
  • fbed1ecfe0 More dict to set Dave Halter 2018-06-17 17:45:40 +02:00
  • 1f27fa9320 Use more nonterminal/terminal terminology Dave Halter 2018-06-17 17:37:15 +02:00
  • 23362ec2d3 Start using the term nonterminal Dave Halter 2018-06-17 16:40:11 +02:00
  • 6b391af071 Use sets instead of dicts if possible Dave Halter 2018-06-17 16:36:27 +02:00
  • c43cb21a0e Add docstring Dave Halter 2018-06-15 17:57:55 +02:00
  • 24346a0d32 Add some comments Dave Halter 2018-06-15 10:21:00 +02:00
  • 9d452ec66a Use a set instead of dict if it's not necessary Dave Halter 2018-06-15 00:35:39 +02:00
  • 567e0d7aed Simplify some code Dave Halter 2018-06-15 00:06:56 +02:00
  • 1f02327cff Some refactorings for simplicity Dave Halter 2018-06-14 18:18:28 +02:00
  • 8c348aee6f Use NFAArc as a class Dave Halter 2018-06-14 10:29:19 +02:00
  • a277ccf288 Some more renames Dave Halter 2018-06-14 01:10:23 +02:00
  • a5ce2caab6 Another rename Dave Halter 2018-06-13 23:19:52 +02:00
  • da4df9c0f1 Rename Dave Halter 2018-06-13 21:12:48 +02:00
  • bd444df417 Move the grammar parsing to a separate module Dave Halter 2018-06-13 21:01:06 +02:00
  • 275dbca1b9 More renames Dave Halter 2018-06-13 20:54:18 +02:00
  • 9a0b6f4928 Rename Dave Halter 2018-06-13 20:47:16 +02:00
  • fc5560874b Separate generating dfas from parsing Dave Halter 2018-06-13 20:46:36 +02:00
  • 6e5a520e7b Cleanup some names Dave Halter 2018-06-13 10:18:05 +02:00
  • dcabf3d415 Remove some code that is not used anymore Dave Halter 2018-06-13 10:15:21 +02:00
  • 3bc82d112d Some cleanups and documentation Dave Halter 2018-06-13 10:10:17 +02:00
  • ec186a78f8 Move out some more functions out of classes Dave Halter 2018-06-13 01:50:25 +02:00