4203 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Dave Halter	2c684906e3	Working with dedents in error recovery.	2014-11-28 21:33:40 +01:00
Dave Halter	31600b9552	classes and functions are new statements and should never get removed by the error recovery.	2014-11-28 02:44:34 +01:00
Dave Halter	128dbd34b6	Check parentheses level in tokenizer.	2014-11-28 02:14:38 +01:00
Dave Halter	e1d6511f2f	Trying to move the indent/dedent logic back into the tokenizer.	2014-11-28 02:04:04 +01:00
Dave Halter	97516eb26b	The new tokenizer is more or less working now. Indents are calculated as they should	2014-11-27 16:03:58 +01:00
Dave Halter	c0df7003a5	Allow both the old tokenizer and the new one (able to toggle).	2014-11-27 01:12:49 +01:00
Dave Halter	c7862925f5	Small tokenizer changes & tokens now have a prefix attribute instead of preceeding_whitespace.	2014-11-27 01:10:45 +01:00
Dave Halter	02cb1fef95	Rename test_tokenizer to test_tokenize.	2014-11-26 16:16:58 +01:00
Dave Halter	cc1098b93c	Fix a few tokenize tests and merge them back together.	2014-11-26 16:09:28 +01:00
Dave Halter	f43c371467	Merge @joel-wright's whitespace tokenizer branch. Thanks!	2014-11-26 15:56:11 +01:00
Dave Halter	427056a22d	Change the pgen2 parser and its driver so that it can be accessed easily from the outside. This is a minor change and will allow Jedis tokenizer to work with pgen2.	2014-11-26 15:38:53 +01:00
Dave Halter	cd1e07a532	The now passing on_import tests should not worsen the performance of the other tests.	2014-11-26 03:11:22 +01:00
Dave Halter	f24a3bf997	Fix on_import tests.	2014-11-26 03:07:41 +01:00
Dave Halter	1326a2137d	Change the backwards tokenizer that keywords always stop.	2014-11-26 02:32:13 +01:00
Dave Halter	a940c31a86	Improvments to on import completion.	2014-11-26 02:13:24 +01:00
Dave Halter	149b4d8ad5	Import completion on syntactically correct imports.	2014-11-26 01:15:40 +01:00
Dave Halter	499c62df43	Fixes for os.path import	2014-11-25 19:39:14 +01:00
Dave Halter	5d82b11f59	First implementation to be ready to complete corrupt imports. Working ok.	2014-11-25 19:35:27 +01:00
Dave Halter	e72eaf7a59	on import completion preparations.	2014-11-25 15:10:36 +01:00
Dave Halter	52d4aaebbe	small fix for docstring parsing.	2014-11-25 15:10:19 +01:00
Dave Halter	5de84afff4	Fix __getitem__	2014-11-24 02:10:02 +01:00
Dave Halter	fae0a7b0c4	Small fixes for past mistakes.	2014-11-24 01:56:54 +01:00
Dave Halter	db76bbccc5	Trying to change the symbols in node. They are now strings. ... With this change we are finally able to get rid of parser/pytree.py	2014-11-24 01:52:41 +01:00
Dave Halter	9f45f18ad1	Added a grammar param to the parser.	2014-11-24 01:10:39 +01:00
Dave Halter	c152a1c58b	Actually replace tree with representation (in all the imports).	2014-11-23 19:46:52 +01:00
Dave Halter	1fbc4c9196	Change parser.representation to parser.tree. It's shorter and says more.	2014-11-23 19:35:46 +01:00
Dave Halter	ac41c31015	Removed more of the old parser representation code.	2014-11-23 19:33:18 +01:00
Dave Halter	9b54541cae	Remove quite a bit of the old parser representation logic.	2014-11-23 19:26:30 +01:00
Dave Halter	0f21d38e2c	Remove the old parser.	2014-11-23 19:17:50 +01:00
Dave Halter	267016f533	Function for evaluating functions with already executed arguments.	2014-11-23 19:12:25 +01:00
Dave Halter	8adfc47297	Fix some issues with params.	2014-11-23 12:22:03 +01:00
Dave Halter	c10ec4f876	star arg iteration improved.	2014-11-23 12:05:19 +01:00
Dave Halter	f1cbd45575	Usages are pretty solid now except for parser issues.	2014-11-22 15:43:23 +01:00
Dave Halter	b82e1e28e5	Get at least some usages stuff right.	2014-11-22 02:05:36 +01:00
Dave Halter	22fbcf6c77	More goto improvements.	2014-11-21 15:45:17 +01:00
Dave Halter	eb0bfb4381	get_code in Definition.description should not return first prefix.	2014-11-21 15:33:38 +01:00
Dave Halter	f604066288	First small implementation of goto.	2014-11-21 14:21:00 +01:00
Dave Halter	fd16dfe2c7	Fix the first part of sys path checks.	2014-11-21 01:46:18 +01:00
Dave Halter	11fa71bac8	Fixes for nested star imports.	2014-11-20 14:56:47 +01:00
Dave Halter	3b7454e294	copy fixes.	2014-11-20 14:51:01 +01:00
Dave Halter	83b09f6c1e	Small issue with is_definition and params. Found by looking at stdlib/random.choice tests.	2014-11-20 14:48:34 +01:00
Dave Halter	cc465364d3	Fixes towards better MergedArray and partial functions.	2014-11-20 13:33:05 +01:00
Dave Halter	a6e1348757	type implementation.	2014-11-20 12:31:11 +01:00
Dave Halter	f2e3a3d090	Just rebuilt reversed.	2014-11-20 11:56:58 +01:00
Dave Halter	53c2a1679c	Fix types tests.	2014-11-20 11:16:52 +01:00
Dave Halter	2c3a7b6d6c	Imports are not Statements.	2014-11-20 02:29:24 +01:00
Dave Halter	164518b993	Get docstrings working.	2014-11-20 02:19:01 +01:00
Dave Halter	ce5d428d22	At least functions generate docstrings again.	2014-11-20 01:37:18 +01:00
Dave Halter	22b288fc73	Change docstring test function names, so that dynamic param completion doesn't interfere (especially because some of those files still generate parser errors).	2014-11-20 00:35:48 +01:00
Dave Halter	b5418d9d73	Small issue with dynamic params.	2014-11-20 00:25:03 +01:00