Dave Halter
3c57f781dd
Move another few tests.
2017-05-15 15:18:42 -04:00
Dave Halter
b4039872bd
Replace Scope.subscopes with iter_funcdefs and iter_classdefs.
2017-04-30 01:36:17 +02:00
Dave Halter
eaa5100372
Removed Scope.statements from the parser tree.
2017-04-28 18:18:58 +02:00
Dave Halter
b4631d6dd4
Progress in removing the docstring/call signature logic from the parser.
2017-04-18 18:48:05 +02:00
Dave Halter
97fc3bc23c
Refactored the parser calls. Now it's possible to use jedi.parser.python.parse to quickly parse something.
2017-03-14 00:38:58 +01:00
Dave Halter
c7a74e6d1c
Make the tokenizer a generator.
2017-03-09 18:53:09 +01:00
Matthias Bussonnier
784de85b36
Add test for handeling of newline in multiline strings
2017-02-24 00:05:38 +01:00
Dave Halter
09779c88aa
Fix a nasty issue in the tokenizer. Fixes #836 .
...
At the same time there was a related issue of not cleaning up newlines properly.
2017-01-24 00:50:37 +01:00
Dave Halter
00a9f1ec0a
Update the tokenizer to include f literals and underscores. Need tests still.
2017-01-08 16:03:45 +01:00
Dave Halter
c6248ae169
Some testing fixes that were broken with the few previous commits.
2016-12-06 18:18:53 +01:00
Dave Halter
ee1f077014
Some test refactorings.
2016-12-03 14:32:00 +01:00
Dave Halter
c4906e0e3f
Rework the parser so we can use arbitrary start nodes of the syntax.
...
This also includes a rework for error recovery in the parser. This is now just possible for file_input parsing, which means for full files.
Includes also a refactoring of the tokenizer. No more do we have to add an additional newline, because it now works correctly (removes certain confusion.
2015-12-20 22:25:41 +01:00
Dave Halter
b6f635b88b
Python 2.7 io.StringIO always needs unicode input.
2015-04-28 02:05:38 +02:00
Dave Halter
0a96083fde
Fix ur'' literals.
2015-04-27 19:21:41 +02:00
Dave Halter
e296b00201
Change the tests of @hamatov a small bit. They are now working with the new parser.
2015-03-06 13:10:59 +01:00
Dave Halter
2cddfd656b
Merge branch 'unicode_tokenize_fix2' of https://github.com/hatamov/jedi into dev
2015-03-06 11:44:03 +01:00
farhad
32081bd156
Merge branch 'dev' into unicode_tokenize_fix2
...
Conflicts:
AUTHORS.txt
2015-03-06 12:14:38 +04:00
farhad
80719fc821
added test for quoted strings parsing
2015-03-06 11:54:01 +04:00
Dave Halter
910f2e6486
Use textwrap.dedent for better readability of the testing code.
2015-03-06 01:49:57 +01:00
Dave Halter
fd1be02f1e
Test for unicode tokens in Python 2.7.
2015-03-06 01:47:37 +01:00
Dave Halter
b57ee880af
Remove assertEqual from tokenize tests, we can do it with just assert, py.test converts all of that automatically.
2015-02-05 00:48:40 +01:00
Dave Halter
c6b818c504
Changed a tokenize test to match the current intended behavior of the tokenizer.
2015-02-05 00:43:25 +01:00
Savor d'Isavano
c3c07c4ec2
Fixed issue #526 .
2015-01-16 18:45:34 +08:00
Dave Halter
e6b9111749
Python 2.7 compatibility.
2015-01-13 02:12:49 +01:00
Dave Halter
cc64265187
Grammar modifications so that the Python2.7 grammar looks more like the Python 3.4 grammar.
2015-01-13 01:05:13 +01:00
Dave Halter
eaace104dd
Replace the tokenizer's output with a tuple (switching back from a Token class).
2014-12-16 00:10:07 +01:00
Dave Halter
fe1d7b7030
Replace the old tokenizer tests with the refactored attributes.
2014-12-07 14:19:21 +01:00
Dave Halter
02cb1fef95
Rename test_tokenizer to test_tokenize.
2014-11-26 16:16:58 +01:00
Dave Halter
cc1098b93c
Fix a few tokenize tests and merge them back together.
2014-11-26 16:09:28 +01:00
Dave Halter
3add6e4289
Fix various bugs.
2014-09-26 12:22:56 +02:00
Dave Halter
9f16555f47
Big refactoring: BaseDefinition._definnition changes to BaseDefinition._name, because it's a NamePart now.
...
This also includes changes to tests and some simplifications like deleting the old name logic of Definition.
2014-09-11 01:03:30 +02:00
Dave Halter
45e033c50e
Quite a few fixes to be eventually able to use NameParts as Definition inputs.
2014-09-09 15:21:27 +02:00
Dave Halter
54dce0e3b2
fix strange issues of Python's std lib tokenizer, might be in there as well (not sure, cause I modified a lot). fixes #449
2014-08-04 16:47:36 +02:00
Dave Halter
b2b4827ce3
moved test_token to test_tokenize
2014-08-04 16:25:33 +02:00
