Dave Halter
e913872192
Merged the tokenize is_identifier changes.
2015-02-01 20:32:01 +01:00
Dave Halter
bc118e8047
Simplify the fast parser tokenizer more. Now it is more readable and less buggy (+bugfixes).
2015-01-31 20:09:44 +01:00
Dave Halter
1826f432c8
Fix an issue in the fast parser splitting.
2015-01-30 15:17:38 +01:00
Dave Halter
413da3b790
Remove the line_offset calculation. We can now also remove it from tokenize. With the position_modifier we have enough tools to change a position, we don't need to do that in tokenize.py.
2015-01-29 17:57:01 +01:00
Dave Halter
a221eee02c
Fix more issues in the fast parser.
2015-01-29 15:38:38 +01:00
Dave Halter
0a537c05c4
Fix an issue with Function/Flow combination in the fast parser.
2015-01-29 02:24:11 +01:00
Dave Halter
dde0e9c7c6
Fix for loop issues in the fast parser.
2015-01-29 01:36:16 +01:00
Dave Halter
e412694fa2
Fix issues with flows in the fast parser.
2015-01-28 17:06:18 +01:00
Dave Halter
d0589430bb
FastModule should inherit from SubModule, because it has almost all the same properties.
2015-01-28 14:59:00 +01:00
Dave Halter
6ec89e6785
Fix issues with flows.
2015-01-28 13:03:57 +01:00
Dave Halter
5e8f8f7a8d
Fix issues with error correction / newline correction.
2015-01-27 12:24:54 +01:00
Dave Halter
4a07f97f10
Reenable a few get_code tests.
2015-01-27 01:19:09 +01:00
Dave Halter
88a3e25814
Fix newline stuff for empty parsers.
2015-01-27 01:15:39 +01:00
Dave Halter
39e869d146
Test added newline module end_pos as well.
2015-01-26 22:02:11 +01:00
Dave Halter
07c60d7ff6
Fix DEDENT issues in _remove_newline.
2015-01-26 21:17:50 +01:00
Dave Halter
61e2bba380
Tests and implementation to remove the last newline again in the parser tree, to be able to exactly reproduce the parser input.
2015-01-26 21:07:14 +01:00
Dave Halter
a8943b8a80
Get the position modifiers right.
2015-01-24 20:42:28 +01:00
Dave Halter
446f5b9018
Fix issues with the right count of parsers used.
2015-01-24 20:19:03 +01:00
Dave Halter
4d6afd3c99
Fix fast parser tests.
2015-01-24 00:06:16 +01:00
Savor d'Isavano
c3c07c4ec2
Fixed issue #526 .
2015-01-16 18:45:34 +08:00
Dave Halter
e6b9111749
Python 2.7 compatibility.
2015-01-13 02:12:49 +01:00
Dave Halter
cc64265187
Grammar modifications so that the Python2.7 grammar looks more like the Python 3.4 grammar.
2015-01-13 01:05:13 +01:00
Dave Halter
ef72f4fb6c
Test the new error correction feature.
2015-01-12 01:27:25 +01:00
Dave Halter
6d58fed0e8
Remove get_defined_names in favor of names_dict in the parser tree.
2015-01-08 13:38:03 +01:00
Dave Halter
eaace104dd
Replace the tokenizer's output with a tuple (switching back from a Token class).
2014-12-16 00:10:07 +01:00
Dave Halter
d6595ad020
Fixed more parser tests.
2014-12-08 00:36:09 +01:00
Dave Halter
fe8a99dfd5
Fix the parser tests.
2014-12-08 00:32:38 +01:00
Dave Halter
34c9422749
The parser tests should also give the parser a grammar.
2014-12-08 00:22:33 +01:00
Dave Halter
fe1d7b7030
Replace the old tokenizer tests with the refactored attributes.
2014-12-07 14:19:21 +01:00
Dave Halter
02cb1fef95
Rename test_tokenizer to test_tokenize.
2014-11-26 16:16:58 +01:00
Dave Halter
cc1098b93c
Fix a few tokenize tests and merge them back together.
2014-11-26 16:09:28 +01:00
Dave Halter
f43c371467
Merge @joel-wright's whitespace tokenizer branch. Thanks!
2014-11-26 15:56:11 +01:00
Dave Halter
03e01631cc
Remove NamePart from existance and rename it to Name.
2014-09-26 16:29:53 +02:00
Dave Halter
3add6e4289
Fix various bugs.
2014-09-26 12:22:56 +02:00
Dave Halter
9f16555f47
Big refactoring: BaseDefinition._definnition changes to BaseDefinition._name, because it's a NamePart now.
...
This also includes changes to tests and some simplifications like deleting the old name logic of Definition.
2014-09-11 01:03:30 +02:00
Dave Halter
45e033c50e
Quite a few fixes to be eventually able to use NameParts as Definition inputs.
2014-09-09 15:21:27 +02:00
Dave Halter
bb5ffe9343
CompiledObject.name returns a Name now, not a string. This is more consistent with the Jedi design and doesn't lead to bugs while ducktyping.
2014-09-03 19:43:21 +02:00
Dave Halter
54dce0e3b2
fix strange issues of Python's std lib tokenizer, might be in there as well (not sure, cause I modified a lot). fixes #449
2014-08-04 16:47:36 +02:00
Dave Halter
b2b4827ce3
moved test_token to test_tokenize
2014-08-04 16:25:33 +02:00
Joel Wright
07d0a43f7e
Add preceding whitespace collection to tokenizer
2014-07-30 11:59:20 +01:00
Dave Halter
cfe54e83ff
incomplete functions shouldn't cause any trouble. fixes #429 .
2014-07-28 17:42:20 +02:00
Dave Halter
606b6851ff
remove the scope_names_generator stuff again. We should enable it somewhere in time, but for now it just breaks tests.
2014-07-27 09:43:22 +02:00
Dave Halter
c85bdb8ff1
little edge case of modules that don't have a scope_names_generator, which is unfortunately missing, but not really used in Jedi.
...
At europython's hackathon we played with it and @scoder added a small script to cython/Cython/Compiler/JediTyper.py, which makes it possible to add Cython types to a Python script.
2014-07-26 13:18:04 +02:00
Akinori Hattori
10b7ed967d
organize imports
2014-07-19 10:41:19 +09:00
Dave Halter
2616143d10
unicode issues with docstrings should be gone, fixes #420
2014-07-18 17:43:25 +02:00
Dave Halter
e07f51387f
added a test for hex value issues in docstrings, see #427
2014-07-18 17:09:44 +02:00
Dave Halter
0f665bf436
test for #424 , issues with form feeds
2014-07-18 16:52:25 +02:00
Dave Halter
21341283ca
another parser issue, very much related to the last one. sometimes a None element was used as a token.fixes #418
2014-07-18 15:10:10 +02:00
Dave Halter
b7bf8d515c
support for completions on return statements.
2014-06-22 12:05:22 +02:00
Dave Halter
06bae0e835
fix test issue with python 2.7
2014-05-16 18:03:36 +02:00
