7 Commits

Author	SHA1	Message	Date
Jean-Louis Fuchs	3204a39f6c	* made Token readonly like a tuple by using @property ... * end_pos calculation didn't respect multiline tokens * replaced all index access to Token * wrapped all code that injects token tuples with Token.from_tuple() * repr of Token is still its tuple form!? * PEP8 where I read or wrote code	2013-12-08 01:32:58 +01:00
Jean-Louis Fuchs	13680945d6	* imported utf8 for python 3.2	2013-12-07 23:00:47 +01:00
Jean-Louis Fuchs	e204c27ecc	* imported u for python 3.2	2013-12-07 22:53:01 +01:00
Jean-Louis Fuchs	5c543ac364	* unicode compatibility	2013-12-07 22:50:20 +01:00
Jean-Louis Fuchs	f1c49db6b6	* Added doctests to Token class ... * Added __setattr__ for symmetry * Code cleanup	2013-12-06 02:51:28 +01:00
Jean-Louis Fuchs	ced926b7f0	* cleanup	2013-12-06 00:11:38 +01:00
Jean-Louis Fuchs	099a6c2697	* added token.py	2013-12-05 23:59:48 +01:00