Dave Halter
d12e030677
use tuples instead of lists if the don't change (immutable is faster and more memory efficient)
2014-03-06 00:26:23 +01:00
Dave Halter
66a488b911
clean up parse_dot_name and other small things
2014-03-05 22:46:11 +01:00
Dave Halter
2322edff8f
keyword statement not includes globals
2014-03-05 00:44:19 +01:00
Dave Halter
f54344fd9e
KeywordStatements are working except for some of the old ones (global, assert, return, yield)
2014-03-04 17:20:29 +01:00
Dave Halter
53fd1f925a
create KeywordStatement to fit assert, del, global, etc into a more generalized schema, which can also improve the get_code method
2014-03-04 15:35:24 +01:00
Dave Halter
65ce609a3c
protect token_list -> _token_list
2014-03-04 12:43:37 +01:00
Dave Halter
3330e29748
more problems fixed that relate to Operator
2014-02-26 22:08:51 +01:00
Dave Halter
2e12eb7861
start with the integration of an Operator class to make way for precedences
2014-02-26 14:44:51 +01:00
Dave Halter
1a3cca6edb
fixed a problem with the fast parser and its strange end positions
2014-02-26 11:23:45 +01:00
Dave Halter
8d1a9f2d46
fix long standing issue with import end_pos
2014-02-26 11:03:19 +01:00
Dave Halter
5e5bb618ea
remove token.py, docstrings are now just normal tokens until used
2014-02-26 01:13:38 +01:00
Dave Halter
18e985a961
TokenInfo -> Token
2014-02-25 16:44:48 +01:00
Dave Halter
6439d6c848
removed the now redundant token.Token version in favor of tokenize.TokenInfo
2014-02-25 16:38:19 +01:00
Dave Halter
2db26abf72
start and end don't exst anymore in parser.token.Token, it's now start_pos/end_pos as everywhere else
2014-02-25 16:34:27 +01:00
Dave Halter
f4f79317fe
start uniting tokenize.TokenInfo and token.Token
2014-02-25 13:54:18 +01:00
Dave Halter
5b84f0b27f
remove end_pos stuff from tokenizer, the tokens can do that themselves
2014-02-25 13:29:27 +01:00
Dave Halter
3a23c80ae5
prepare for eventual? tokenizer end_pos replacement.
2014-02-25 11:59:10 +01:00
Dave Halter
e2a6d1dd43
remove offset param for Parser
2014-02-25 01:31:24 +01:00
Dave Halter
44d560c53a
finally removed self-contained iterator from Parser - after knowing this since almost the beginning.
2014-02-25 01:26:19 +01:00
Dave Halter
a7a8a73a2c
removed Parser._start_pos as well
2014-02-25 01:20:55 +01:00
Dave Halter
add8259d7e
successfully removed end_pos from parser
2014-02-25 01:05:00 +01:00
Dave Halter
936c7dfde4
protect start_pos/end_pos in parser to hopefully remove them soon
2014-02-25 00:27:39 +01:00
Dave Halter
a5a6e9ac12
parser: remove current
2014-02-24 20:43:00 +01:00
Dave Halter
50f8b8bf0c
start using tokens all the way through in the parser
2014-02-24 20:35:36 +01:00
Dave Halter
6058e8b9c3
remove unnecessary checks
2014-02-24 11:40:05 +01:00
Dave Halter
9943bb6205
remove some old parameters from Parser and FastTokenizer
2014-02-24 11:24:54 +01:00
Dave Halter
9257062910
remove NoErrorTokenizer dependency for all but the fast parsers
2014-02-24 10:31:15 +01:00
Dave Halter
73057d4176
removed the INDENT usages that were left in the parser code
2014-02-21 15:39:14 +01:00
Dave Halter
3232ae5b0c
removed parentheses counting from generate_tokens
2014-02-20 18:45:22 +01:00
Dave Halter
d7033726fd
tokenize removed NL/NEWLINE ambiguity
2014-02-20 01:52:30 +01:00
Dave Halter
c26ae3c00d
ignore dedents in tokenizer
2014-02-20 01:21:20 +01:00
Dave Halter
3e9b72b636
created a PushBackTokenizer specifically for the parser
2014-02-20 01:17:19 +01:00
Dave Halter
c8d6fbb0a1
temporary changes for the tokenizer issues
2014-02-20 00:43:42 +01:00
Dave Halter
bb111daf91
removed line from tokenizer
2014-02-16 15:28:18 +01:00
Dave Halter
22928dbcd0
simplified some crazy iterator stuff within parser
2014-02-16 15:04:57 +01:00
Jean-Louis Fuchs
34e89fa1c5
Merge branch 'dev' into get_code_fidelity
...
Conflicts:
jedi/evaluate/docstrings.py
jedi/parser/representation.py
Resolving merge problems:
* Introducing docstring for compiled.fake
* Partly fixing poor decision in TokenDocstring __init__
2014-01-28 00:37:06 +01:00
Dave Halter
7c105d27e0
some tests survive the new interpreter module already
2014-01-22 15:17:50 +01:00
Dave Halter
aa59aee3dc
user_position removed from Parser. yikes!
2014-01-17 02:58:03 +01:00
Dave Halter
19b0e1d5b6
reenable check_user_statement in parser, that did the whole user names calculation
2014-01-17 02:48:00 +01:00
Dave Halter
b30a186f8f
remove user_stmt and user_scope stuff - yes!
2014-01-17 02:34:09 +01:00
Dave Halter
8b34e120e0
for loops are now parsed even if they are really faulty and don't end.
2014-01-17 01:39:23 +01:00
Dave Halter
92eba44d07
allow for flows to also be very faulty
2014-01-17 01:26:34 +01:00
Dave Halter
e5d40c3685
flow syntax errors should still make it possible to add them to the parser (otherwise parser doesn't include all the code
2014-01-17 01:15:36 +01:00
Dave Halter
682e1c2708
debug.dbg and debug.warning now take a string and format args parameters to make debugging a little bit cleaner
2014-01-13 16:16:07 +01:00
Dave Halter
2e65fbb00f
rename parser.tokenizer -> parser.tokenize
2014-01-05 13:38:14 +01:00
Dave Halter
261f49d3e2
move NoErrorTokenizer to the tokenizer module, where it more or less belongs.
2014-01-05 13:34:29 +01:00
Dave Halter
e115689b7f
move NoErrorTokenizer to the parser, where it more or less belongs.
2014-01-05 13:25:11 +01:00
Dave Halter
7bf6ff768c
first steps to world domination -> removal of the hackish sys.path modifications
2013-12-24 16:23:13 +01:00
Jean-Louis Fuchs
d687fa4df6
* replaced docstr-string with TokenDocstring object
2013-12-13 01:22:56 +01:00
Jean-Louis Fuchs
3204a39f6c
* made Token readonly like a tuple by using @property
...
* end_pos calculation didn't respect multiline tokens
* replaced all index access to Token
* wrapped all code that injects token tuples with
Token.from_tuple()
* repr of Token is still its tuple form!?
* PEP8 where I read or wrote code
2013-12-08 01:32:58 +01:00