55 Commits

Author	SHA1	Message	Date
Dave Halter	5764e760d2	improve internal module links for sphinx documentation	2014-03-11 15:46:08 +01:00
Dave Halter	cd7774f25f	lambda can be used as a default param in function, which means there have been slight changes to the parser to allow that (comma in a function definitions doesn't always mean new param), fixes #379	2014-03-11 12:24:36 +01:00
Dave Halter	0dcc924cf8	precedence working for some simple cases (and invalid statements)	2014-03-08 02:24:25 +01:00
Dave Halter	d12e030677	use tuples instead of lists if the don't change (immutable is faster and more memory efficient)	2014-03-06 00:26:23 +01:00
Dave Halter	66a488b911	clean up parse_dot_name and other small things	2014-03-05 22:46:11 +01:00
Dave Halter	2322edff8f	keyword statement not includes globals	2014-03-05 00:44:19 +01:00
Dave Halter	f54344fd9e	KeywordStatements are working except for some of the old ones (global, assert, return, yield)	2014-03-04 17:20:29 +01:00
Dave Halter	53fd1f925a	create KeywordStatement to fit assert, del, global, etc into a more generalized schema, which can also improve the get_code method	2014-03-04 15:35:24 +01:00
Dave Halter	65ce609a3c	protect token_list -> _token_list	2014-03-04 12:43:37 +01:00
Dave Halter	3330e29748	more problems fixed that relate to Operator	2014-02-26 22:08:51 +01:00
Dave Halter	2e12eb7861	start with the integration of an Operator class to make way for precedences	2014-02-26 14:44:51 +01:00
Dave Halter	1a3cca6edb	fixed a problem with the fast parser and its strange end positions	2014-02-26 11:23:45 +01:00
Dave Halter	8d1a9f2d46	fix long standing issue with import end_pos	2014-02-26 11:03:19 +01:00
Dave Halter	5e5bb618ea	remove token.py, docstrings are now just normal tokens until used	2014-02-26 01:13:38 +01:00
Dave Halter	18e985a961	TokenInfo -> Token	2014-02-25 16:44:48 +01:00
Dave Halter	6439d6c848	removed the now redundant token.Token version in favor of tokenize.TokenInfo	2014-02-25 16:38:19 +01:00
Dave Halter	2db26abf72	start and end don't exst anymore in parser.token.Token, it's now start_pos/end_pos as everywhere else	2014-02-25 16:34:27 +01:00
Dave Halter	f4f79317fe	start uniting tokenize.TokenInfo and token.Token	2014-02-25 13:54:18 +01:00
Dave Halter	5b84f0b27f	remove end_pos stuff from tokenizer, the tokens can do that themselves	2014-02-25 13:29:27 +01:00
Dave Halter	3a23c80ae5	prepare for eventual? tokenizer end_pos replacement.	2014-02-25 11:59:10 +01:00
Dave Halter	e2a6d1dd43	remove offset param for Parser	2014-02-25 01:31:24 +01:00
Dave Halter	44d560c53a	finally removed self-contained iterator from Parser - after knowing this since almost the beginning.	2014-02-25 01:26:19 +01:00
Dave Halter	a7a8a73a2c	removed Parser._start_pos as well	2014-02-25 01:20:55 +01:00
Dave Halter	add8259d7e	successfully removed end_pos from parser	2014-02-25 01:05:00 +01:00
Dave Halter	936c7dfde4	protect start_pos/end_pos in parser to hopefully remove them soon	2014-02-25 00:27:39 +01:00
Dave Halter	a5a6e9ac12	parser: remove current	2014-02-24 20:43:00 +01:00
Dave Halter	50f8b8bf0c	start using tokens all the way through in the parser	2014-02-24 20:35:36 +01:00
Dave Halter	6058e8b9c3	remove unnecessary checks	2014-02-24 11:40:05 +01:00
Dave Halter	9943bb6205	remove some old parameters from Parser and FastTokenizer	2014-02-24 11:24:54 +01:00
Dave Halter	9257062910	remove NoErrorTokenizer dependency for all but the fast parsers	2014-02-24 10:31:15 +01:00
Dave Halter	73057d4176	removed the INDENT usages that were left in the parser code	2014-02-21 15:39:14 +01:00
Dave Halter	3232ae5b0c	removed parentheses counting from generate_tokens	2014-02-20 18:45:22 +01:00
Dave Halter	d7033726fd	tokenize removed NL/NEWLINE ambiguity	2014-02-20 01:52:30 +01:00
Dave Halter	c26ae3c00d	ignore dedents in tokenizer	2014-02-20 01:21:20 +01:00
Dave Halter	3e9b72b636	created a PushBackTokenizer specifically for the parser	2014-02-20 01:17:19 +01:00
Dave Halter	c8d6fbb0a1	temporary changes for the tokenizer issues	2014-02-20 00:43:42 +01:00
Dave Halter	bb111daf91	removed line from tokenizer	2014-02-16 15:28:18 +01:00
Dave Halter	22928dbcd0	simplified some crazy iterator stuff within parser	2014-02-16 15:04:57 +01:00
Jean-Louis Fuchs	34e89fa1c5	Merge branch 'dev' into get_code_fidelity ... Conflicts: jedi/evaluate/docstrings.py jedi/parser/representation.py Resolving merge problems: * Introducing docstring for compiled.fake * Partly fixing poor decision in TokenDocstring __init__	2014-01-28 00:37:06 +01:00
Dave Halter	7c105d27e0	some tests survive the new interpreter module already	2014-01-22 15:17:50 +01:00
Dave Halter	aa59aee3dc	user_position removed from Parser. yikes!	2014-01-17 02:58:03 +01:00
Dave Halter	19b0e1d5b6	reenable check_user_statement in parser, that did the whole user names calculation	2014-01-17 02:48:00 +01:00
Dave Halter	b30a186f8f	remove user_stmt and user_scope stuff - yes!	2014-01-17 02:34:09 +01:00
Dave Halter	8b34e120e0	for loops are now parsed even if they are really faulty and don't end.	2014-01-17 01:39:23 +01:00
Dave Halter	92eba44d07	allow for flows to also be very faulty	2014-01-17 01:26:34 +01:00
Dave Halter	e5d40c3685	flow syntax errors should still make it possible to add them to the parser (otherwise parser doesn't include all the code	2014-01-17 01:15:36 +01:00
Dave Halter	682e1c2708	debug.dbg and debug.warning now take a string and format args parameters to make debugging a little bit cleaner	2014-01-13 16:16:07 +01:00
Dave Halter	2e65fbb00f	rename parser.tokenizer -> parser.tokenize	2014-01-05 13:38:14 +01:00
Dave Halter	261f49d3e2	move NoErrorTokenizer to the tokenizer module, where it more or less belongs.	2014-01-05 13:34:29 +01:00
Dave Halter	e115689b7f	move NoErrorTokenizer to the parser, where it more or less belongs.	2014-01-05 13:25:11 +01:00