Dave Halter 261f49d3e2 move NoErrorTokenizer to the tokenizer module, where it more or less belongs.

2014-01-05 13:34:29 +01:00

..

__init__.py

move NoErrorTokenizer to the tokenizer module, where it more or less belongs.

2014-01-05 13:34:29 +01:00

fast.py

move NoErrorTokenizer to the tokenizer module, where it more or less belongs.

2014-01-05 13:34:29 +01:00

representation.py

use it for the parser representation as well

2014-01-05 11:29:12 +01:00

token.py

* made Token readonly like a tuple by using @property

2013-12-08 01:32:58 +01:00

tokenizer.py

move NoErrorTokenizer to the tokenizer module, where it more or less belongs.

2014-01-05 13:34:29 +01:00