VimPlug/typeshed
1
0 Fork 0
mirror of https://github.com/davidhalter/typeshed.git synced 2026-10-15 18:42:41 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

tokenize: add generate_tokens in py3 (#1449)

Browse Source 
Fixes #1433

This is undocumented but somebody is asking for it to be included.
This commit is contained in:
Jelle Zijlstra authored and Matthias Kramm committed 2017-07-04 19:17:39 -07:00
1 parent ab5f196fca
commit e980c8987b
1 file changed
+1
Download Patch File Download Diff File Expand all files Collapse all files
stdlib/3/tokenize.pyi
+1
View File
@@ -39,6 +39,7 @@ class Untokenizer:
def untokenize(iterable: Iterable[_Token]) -> Any: ...
def detect_encoding(readline: Callable[[], bytes]) -> Tuple[str, Sequence[bytes]]: ...
def tokenize(readline: Callable[[], bytes]) -> Generator[TokenInfo, None, None]: ...
def generate_tokens(readline: Callable[[], str]) -> Generator[TokenInfo, None, None]: ...
def open(filename: Union[str, bytes, int]) -> TextIO: ...