Commit Graph
100 Commits
Author SHA1 Message Date
Dave Halter 7f0e31798a fix an old test case that was always wrong anyway 2014-03-09 12:40:38 +01:00
Dave Halter b22c9c96f2 string additions also work now - be prepared #24! 2014-03-09 12:36:17 +01:00
Dave Halter 70e1970f40 plus on numbers is now basically working 2014-03-09 12:27:03 +01:00
Dave Halter 3b372e2fe2 add some operator tests for precedences (array indexing) 2014-03-09 12:00:28 +01:00
Dave Halter 60ff2bc088 fix an invalid statement that has changed because of changes to the parser. 2014-03-09 11:56:29 +01:00
Dave Halter 35548cbf3c clean up the new _eval_statement_element method 2014-03-09 02:44:23 +01:00
Dave Halter f26e3770dd ternary operator implementation, precedences complete and working, now 2014-03-09 02:41:07 +01:00
Dave Halter e2832e1172 fix multiplication of arrays with precedences 2014-03-09 02:23:38 +01:00
Dave Halter 61fa9b7fb4 start using precedences, working good with only a few test fails 2014-03-09 02:10:59 +01:00
Dave Halter 48dd8f9cb0 slice precedences should be working as well. 2014-03-09 01:05:46 +01:00
Dave Halter 29cfdfeab1 precedence integration preparation 2014-03-08 23:43:29 +01:00
Dave Halter 11346d0901 get the 'not' priorities right for precedences 2014-03-08 03:14:05 +01:00
Dave Halter 3559dba7ea to the power of precedences 2014-03-08 03:05:38 +01:00
Dave Halter 0a253b4651 MultiPart string precedences seem to be working now 2014-03-08 02:52:26 +01:00
Dave Halter 0dcc924cf8 precedence working for some simple cases (and invalid statements) 2014-03-08 02:24:25 +01:00
Dave Halter f2e2a684d5 precedence tests and a parse_tree method for Precedence objects 2014-03-07 15:05:28 +01:00
Dave Halter 77bfb0fb7b basic precedence algorithm - not tested yet 2014-03-07 14:40:57 +01:00
Dave Halter ca460ac34f fixed a problem with docstrings that were empty (None), docstrings in Jedi are always strings. 2014-03-06 12:20:11 +01:00
Dave Halter d12e030677 use tuples instead of lists if the don't change (immutable is faster and more memory efficient) 2014-03-06 00:26:23 +01:00
Dave Halter a97c91002f replace name and statement end_pos (this way we can get rid of all that end_pos crap soon) 2014-03-05 23:46:39 +01:00
Dave Halter 66a488b911 clean up parse_dot_name and other small things 2014-03-05 22:46:11 +01:00
Dave Halter 1f7e4ca637 dict literals are now working (at least the parser) 2014-03-05 18:46:43 +01:00
Dave Halter 387319fde5 simplify parse_array again (closure in statement parser) 2014-03-05 16:54:21 +01:00
Dave Halter 7222d70ecb restructure token breaks in statement parser 2014-03-05 14:39:21 +01:00
Dave Halter 7d7a86239c tests for list comprehensions with included dict literals 2014-03-05 14:23:53 +01:00
Dave Halter 14aca9708e forgot to change to docs - only changed the readme 2014-03-05 12:36:54 +01:00
Dave Halter eb1c6f813a add a TextMate plugin link, by @lawrenceakka 2014-03-05 12:32:36 +01:00
Dave Halter 5f8f1e170b moved global variables handling 2014-03-05 01:19:18 +01:00
Dave Halter 2322edff8f keyword statement not includes globals 2014-03-05 00:44:19 +01:00
Dave Halter f4b235a35d Merge branch 'dev' of github.com:davidhalter/jedi into dev 2014-03-04 17:36:01 +01:00
Dave Halter 8bd8ba1df8 don't need to generate 'pass' anymore if a class is empty in get_code 2014-03-04 17:27:26 +01:00
Dave Halter f54344fd9e KeywordStatements are working except for some of the old ones (global, assert, return, yield) 2014-03-04 17:20:29 +01:00
Dave Halter 53fd1f925a create KeywordStatement to fit assert, del, global, etc into a more generalized schema, which can also improve the get_code method 2014-03-04 15:35:24 +01:00
Dave Halter 65ce609a3c protect token_list -> _token_list 2014-03-04 12:43:37 +01:00
Dave Halter 7de4b14461 remove crazy PushBackIterator from statement parser 2014-02-27 17:40:01 +01:00
Dave Halter 85b5fdf85f again... statement parser 2014-02-27 17:12:16 +01:00
Dave Halter 1eba63760e more change to simplify the statement parser 2014-02-27 16:58:08 +01:00
Dave Halter 8688def619 more statement parser deletions 2014-02-27 11:42:16 +01:00
Dave Halter 38d940cc2b remove start_pos definition from statement parser 2014-02-27 11:36:58 +01:00
Dave Halter 2061fbcacc small parse_stmt refactoring 2014-02-27 00:43:27 +01:00
Dave Halter 6577fa4336 just check for unicode, the parser doesn't know str anymore :) 2014-02-27 00:31:41 +01:00
Dave Halter 3332eba3f7 lambda problem with new operators 2014-02-27 00:17:52 +01:00
Dave Halter fdabca20e9 fix get_code method for Operator (still ugly, though) 2014-02-26 22:23:21 +01:00
Dave Halter 3330e29748 more problems fixed that relate to Operator 2014-02-26 22:08:51 +01:00
Dave Halter 45517a9b8f Merge pull request #378 from ColinDuquesnoy/issue373
CompiledObject params, fixes #373
2014-02-26 19:47:30 +04:30
Dave Halter 2e12eb7861 start with the integration of an Operator class to make way for precedences 2014-02-26 14:44:51 +01:00
Dave Halter e152939791 remove encoding stuff from tokenizer - encoding is always unicode 2014-02-26 12:55:32 +01:00
Dave Halter 1a3cca6edb fixed a problem with the fast parser and its strange end positions 2014-02-26 11:23:45 +01:00
Dave Halter 8d1a9f2d46 fix long standing issue with import end_pos 2014-02-26 11:03:19 +01:00
Dave Halter b28f8fc7b4 test_parsing -> test_parser 2014-02-26 10:45:28 +01:00
Dave Halter acec5fe76f fake docstrs fixed 2014-02-26 02:38:28 +01:00
Dave Halter 44e16c11e5 fixed docstr problems with unified interfaces 2014-02-26 02:33:18 +01:00
Dave Halter 5e5bb618ea remove token.py, docstrings are now just normal tokens until used 2014-02-26 01:13:38 +01:00
Dave Halter 40be00826e clean up tokenize 2014-02-25 17:17:33 +01:00
Dave Halter 761c28ef00 remove __getitem__ from Token 2014-02-25 17:03:56 +01:00
Dave Halter 66aca8eba1 user_context now doesn't work with the token tuple anymore 2014-02-25 16:49:44 +01:00
Dave Halter 18e985a961 TokenInfo -> Token 2014-02-25 16:44:48 +01:00
Dave Halter 6439d6c848 removed the now redundant token.Token version in favor of tokenize.TokenInfo 2014-02-25 16:38:19 +01:00
Dave Halter 2db26abf72 start and end don't exst anymore in parser.token.Token, it's now start_pos/end_pos as everywhere else 2014-02-25 16:34:27 +01:00
Dave Halter ee7108cc11 successfully removed __str__ and __unicode__ methods from token.Token 2014-02-25 16:21:53 +01:00
Dave Halter aea2c4620f more unicode switches in the parser 2014-02-25 14:27:50 +01:00
Dave Halter f4f79317fe start uniting tokenize.TokenInfo and token.Token 2014-02-25 13:54:18 +01:00
Dave Halter 5b84f0b27f remove end_pos stuff from tokenizer, the tokens can do that themselves 2014-02-25 13:29:27 +01:00
Dave Halter 2252271bf5 fix unicode issues with python2.7 2014-02-25 12:54:06 +01:00
Dave Halter 3a23c80ae5 prepare for eventual? tokenizer end_pos replacement. 2014-02-25 11:59:10 +01:00
Dave Halter 246118f851 start using @ganwell's new token class (modified in some ways) as the main token class - hope to gain a little bit of memory/cpu/pickling performance 2014-02-25 02:06:26 +01:00
Dave Halter e2a6d1dd43 remove offset param for Parser 2014-02-25 01:31:24 +01:00
Dave Halter 44d560c53a finally removed self-contained iterator from Parser - after knowing this since almost the beginning. 2014-02-25 01:26:19 +01:00
Dave Halter a7a8a73a2c removed Parser._start_pos as well 2014-02-25 01:20:55 +01:00
Dave Halter add8259d7e successfully removed end_pos from parser 2014-02-25 01:05:00 +01:00
Dave Halter 936c7dfde4 protect start_pos/end_pos in parser to hopefully remove them soon 2014-02-25 00:27:39 +01:00
Dave Halter ef8d3633dd use the module end_pos in fast parser 2014-02-25 00:18:24 +01:00
Dave Halter a5a6e9ac12 parser: remove current 2014-02-24 20:43:00 +01:00
Dave Halter 50f8b8bf0c start using tokens all the way through in the parser 2014-02-24 20:35:36 +01:00
Dave Halter 6058e8b9c3 remove unnecessary checks 2014-02-24 11:40:05 +01:00
Dave Halter 9943bb6205 remove some old parameters from Parser and FastTokenizer 2014-02-24 11:24:54 +01:00
Dave Halter 7db090a48a moved NoErrorTokenizer to fast.FastTokenizer 2014-02-24 11:05:31 +01:00
Dave Halter 9257062910 remove NoErrorTokenizer dependency for all but the fast parsers 2014-02-24 10:31:15 +01:00
Dave Halter 553ff66c8b remove last_previous from NoErrorTokenizer 2014-02-23 12:51:05 +01:00
Dave Halter 8e847f4982 fix python 2.7 issues. the parser now only takes unicode inputs 2014-02-23 11:44:32 +01:00
Dave Halter c5fcebde82 changed _compatibility.utf8 -> 'u' and removed a lot of the issues with the now enforced unicode source input of the parser 2014-02-23 11:29:00 +01:00
Dave Halter 5478e50f8b Merge branch 'dev' of github.com:davidhalter/jedi into dev 2014-02-21 17:52:44 +01:00
Dave Halter 9c2fcfffd7 StringIo is now always used as part of the io library 2014-02-21 17:52:09 +01:00
Dave Halter d9bf9be35e small refactorings of the tokenizer 2014-02-21 17:45:56 +01:00
Dave Halter efba0cd80c deleted a big part of the generate_tokens code that doesn't seem to be needed anymore 2014-02-21 16:38:15 +01:00
Dave Halter 73057d4176 removed the INDENT usages that were left in the parser code 2014-02-21 15:39:14 +01:00
Dave Halter fe02088dd7 restructure user_context reverse tokenizer to remove INDENT tokens in the future 2014-02-21 15:30:46 +01:00
Dave Halter 9c3b7b9c46 get rid of more variables 2014-02-21 10:44:33 +01:00
Dave Halter 184e90a3a0 removed some line checks from tokenizer 2014-02-21 00:13:23 +01:00
Dave Halter a69eee5876 error tokens only exist in the end in a tokenizer 2014-02-21 00:09:49 +01:00
Dave Halter 3232ae5b0c removed parentheses counting from generate_tokens 2014-02-20 18:45:22 +01:00
Dave Halter 7e651684ff fix problems with debug mode if not correctly initialized. 2014-02-20 14:17:05 +01:00
Dave Halter d7033726fd tokenize removed NL/NEWLINE ambiguity 2014-02-20 01:52:30 +01:00
Dave Halter c26ae3c00d ignore dedents in tokenizer 2014-02-20 01:21:20 +01:00
Dave Halter 3e9b72b636 created a PushBackTokenizer specifically for the parser 2014-02-20 01:17:19 +01:00
Dave Halter c8d6fbb0a1 temporary changes for the tokenizer issues 2014-02-20 00:43:42 +01:00
Dave Halter 000e929e3c Merge pull request #375 from ColinDuquesnoy/dev
Fix import of compiled module with python3.
2014-02-19 22:11:27 +04:30
Dave Halter 1b6df4602d replace parser tokenizer offset with line offset 2014-02-17 23:02:04 +01:00
Dave Halter 6952596117 implement an offset in generate_tokens 2014-02-17 10:08:32 +01:00
Dave Halter bb111daf91 removed line from tokenizer 2014-02-16 15:28:18 +01:00