diff --git a/parso/parser.py b/parso/parser.py index 7edf88c..7709e3a 100644 --- a/parso/parser.py +++ b/parso/parser.py @@ -1,7 +1,7 @@ """ The ``Parser`` tries to convert the available Python code in an easy to read format, something like an abstract syntax tree. The classes who represent this -tree, are sitting in the :mod:`jedi.parser.tree` module. +tree, are sitting in the :mod:`parso.tree` module. The Python module ``tokenize`` is a very important part in the ``Parser``, because it splits the code into different words (tokens). Sometimes it looks a diff --git a/parso/tokenize.py b/parso/tokenize.py index ee00717..5134582 100644 --- a/parso/tokenize.py +++ b/parso/tokenize.py @@ -2,8 +2,8 @@ """ This tokenizer has been copied from the ``tokenize.py`` standard library tokenizer. The reason was simple: The standard library tokenizer fails -if the indentation is not right. The fast parser of jedi however requires -"wrong" indentation. +if the indentation is not right. To make it possible to do error recovery the + tokenizer needed to be rewritten. Basically this is a stripped down version of the standard library module, so you can read the documentation there. Additionally we included some speed and