Some docstring changes.

This commit is contained in:
Dave Halter
2017-05-11 16:11:53 -04:00
parent 944ceae0af
commit 802629d6ca
2 changed files with 3 additions and 3 deletions
+2 -2
View File
@@ -2,8 +2,8 @@
"""
This tokenizer has been copied from the ``tokenize.py`` standard library
tokenizer. The reason was simple: The standard library tokenizer fails
if the indentation is not right. The fast parser of jedi however requires
"wrong" indentation.
if the indentation is not right. To make it possible to do error recovery the
tokenizer needed to be rewritten.
Basically this is a stripped down version of the standard library module, so
you can read the documentation there. Additionally we included some speed and