Dave Halter 09779c88aa Fix a nasty issue in the tokenizer. Fixes #836. ...

At the same time there was a related issue of not cleaning up newlines properly.

2017-01-24 00:50:37 +01:00

..

pgen2

Adding a token in pgen should have the same signature that the tokenizer uses.

2016-06-14 18:09:31 +02:00

__init__.py

Fix a nasty issue in the tokenizer. Fixes #836.

2017-01-24 00:50:37 +01:00

diff.py

Use the same function to detect newlines in the diff parser.

2017-01-23 09:56:38 +01:00

grammar2.7.txt

Some python 2.7 (and 3.3) compatibility improvements.

2016-07-03 02:54:21 +02:00

grammar3.4.txt

Fix fast parser tests.

2015-01-24 00:06:16 +01:00

grammar3.5.txt

opting for skipping PEP492 backwards compatibility magic, instead directly making await and async keywords

2016-02-11 19:30:01 +01:00

grammar3.6.txt

parser: add grammar3.6

2016-12-30 22:18:03 -05:00

token.py

add ATEQUAL token for python < 3.5

2016-02-09 18:17:31 +01:00

tokenize.py

Fix a nasty issue in the tokenizer. Fixes #836.

2017-01-24 00:50:37 +01:00

tree.py

Removed tree.is_node.

2017-01-23 20:34:30 +01:00

utils.py

Merge with master.

2017-01-02 13:05:45 +01:00