Dave Halter 5b84f0b27f remove end_pos stuff from tokenizer, the tokens can do that themselves

2014-02-25 13:29:27 +01:00

..

__init__.py

remove end_pos stuff from tokenizer, the tokens can do that themselves

2014-02-25 13:29:27 +01:00

fast.py

remove end_pos stuff from tokenizer, the tokens can do that themselves

2014-02-25 13:29:27 +01:00

representation.py

fix python 2.7 issues. the parser now only takes unicode inputs

2014-02-23 11:44:32 +01:00

token.py

changed _compatibility.utf8 -> 'u' and removed a lot of the issues with the now enforced unicode source input of the parser

2014-02-23 11:29:00 +01:00

tokenize.py

remove end_pos stuff from tokenizer, the tokens can do that themselves

2014-02-25 13:29:27 +01:00

user_context.py

fix unicode issues with python2.7

2014-02-25 12:54:06 +01:00