Dave Halter
d5e3a09c44
Python 2 compatibility with the new tokens.
2014-12-16 02:03:05 +01:00
Dave Halter
fd1cb86765
Now able to remove both tokenize and token from pgen2.
2014-12-16 02:00:33 +01:00
Dave Halter
d9d3740c92
Trying to replace the old pgen2 token module with a token module more tightly coupled to the standard library.
2014-12-16 01:52:15 +01:00
Dave Halter
5e5bb618ea
remove token.py, docstrings are now just normal tokens until used
2014-02-26 01:13:38 +01:00
Dave Halter
761c28ef00
remove __getitem__ from Token
2014-02-25 17:03:56 +01:00
Dave Halter
18e985a961
TokenInfo -> Token
2014-02-25 16:44:48 +01:00
Dave Halter
6439d6c848
removed the now redundant token.Token version in favor of tokenize.TokenInfo
2014-02-25 16:38:19 +01:00
Dave Halter
ee7108cc11
successfully removed __str__ and __unicode__ methods from token.Token
2014-02-25 16:21:53 +01:00
Dave Halter
aea2c4620f
more unicode switches in the parser
2014-02-25 14:27:50 +01:00
Dave Halter
f4f79317fe
start uniting tokenize.TokenInfo and token.Token
2014-02-25 13:54:18 +01:00
Dave Halter
c5fcebde82
changed _compatibility.utf8 -> 'u' and removed a lot of the issues with the now enforced unicode source input of the parser
2014-02-23 11:29:00 +01:00
Dave Halter
82f27569b2
little changes to clean up the code (flake8)
2014-02-14 12:53:22 +01:00
Dave Halter
040ea2b735
fix a few annoyances to be quicker to develop now (disabled a few tests for now)
2014-02-13 15:40:51 +01:00
Jean-Louis Fuchs
34e89fa1c5
Merge branch 'dev' into get_code_fidelity
...
Conflicts:
jedi/evaluate/docstrings.py
jedi/parser/representation.py
Resolving merge problems:
* Introducing docstring for compiled.fake
* Partly fixing poor decision in TokenDocstring __init__
2014-01-28 00:37:06 +01:00
Jean-Louis Fuchs
cc1a89b637
* simplified statement
2013-12-13 01:24:25 +01:00
Jean-Louis Fuchs
d687fa4df6
* replaced docstr-string with TokenDocstring object
2013-12-13 01:22:56 +01:00
Jean-Louis Fuchs
3204a39f6c
* made Token readonly like a tuple by using @property
...
* end_pos calculation didn't respect multiline tokens
* replaced all index access to Token
* wrapped all code that injects token tuples with
Token.from_tuple()
* repr of Token is still its tuple form!?
* PEP8 where I read or wrote code
2013-12-08 01:32:58 +01:00
Jean-Louis Fuchs
13680945d6
* imported utf8 for python 3.2
2013-12-07 23:00:47 +01:00
Jean-Louis Fuchs
e204c27ecc
* imported u for python 3.2
2013-12-07 22:53:01 +01:00
Jean-Louis Fuchs
5c543ac364
* unicode compatibility
2013-12-07 22:50:20 +01:00
Jean-Louis Fuchs
f1c49db6b6
* Added doctests to Token class
...
* Added __setattr__ for symmetry
* Code cleanup
2013-12-06 02:51:28 +01:00
Jean-Louis Fuchs
ced926b7f0
* cleanup
2013-12-06 00:11:38 +01:00
Jean-Louis Fuchs
099a6c2697
* added token.py
2013-12-05 23:59:48 +01:00
