Dave Halter c7a74e6d1c Make the tokenizer a generator.

2017-03-09 18:53:09 +01:00

..

__init__.py

The driver file is now empty.

2014-12-15 17:27:27 +01:00

grammar.py

Trying to replace the old pgen2 token module with a token module more tightly coupled to the standard library.

2014-12-16 01:52:15 +01:00

parse.py

Adding a token in pgen should have the same signature that the tokenizer uses.

2016-06-14 18:09:31 +02:00

pgen.py

Make the tokenizer a generator.

2017-03-09 18:53:09 +01:00