Re-organize directory structure (#4971)

See discussion in #2491

Co-authored-by: Ivan Levkivskyi <ilevkivskyi@dropbox.com>
This commit is contained in:
Ivan LevkivskyiandIvan Levkivskyi authored and GitHub committed 2021-01-27 12:00:39 +00:00
1 parent 869238e587
commit 16ae4c6120
1399 files changed
+601 -97

No files matched your search

+7
View File
@@ -0,0 +1,7 @@
class RobotFileParser:
def set_url(self, url: str): ...
def read(self): ...
def parse(self, lines: str): ...
def can_fetch(self, user_agent: str, url: str): ...
def mtime(self): ...
def modified(self): ...