1
0
Commit Graph

41 Commits

Author SHA1 Message Date
86ef44aa07
Version changed to 0.5.1. 2021-05-04 03:58:02 +04:00
419fb2b673
Removed excessive comparison of hash. Added message when file cannot be retrieved. 2021-05-04 03:56:59 +04:00
0287d3a132
Turned a string into f-string. 2021-05-04 03:55:32 +04:00
b335891097
Copyright, date, and version are updated. 2021-05-03 02:41:32 +04:00
1213cef776
Lolifox removed. Added skip_posts handling. 2021-05-03 02:40:57 +04:00
78d4a62c17
IB parsers rewritten accordingly to fixed Parser class. 2021-05-03 02:40:21 +04:00
f3ef07af68
Rewrite of Parser class because it was fucked up. Now there's no problems with inheritance and its subclasses now more pleasant to write. ThreadNotFoundError now has a reason field. 2021-05-03 02:38:46 +04:00
6373518dc3
Added order=True for FIleInfo to make sure that order of fields is preserved. 2021-05-03 02:36:17 +04:00
caf18a1bf0
Added option --skip-posts and messages are now takes just one line. 2021-05-03 02:35:31 +04:00
751549f575
A new generalised class for all imageboards based on Tinyboard or having identical API. 2021-05-03 02:34:38 +04:00
38b5740d73
Removing lolifox.cc parser because this board is dead. 2021-05-03 02:33:52 +04:00
2f9d26427c
Now incrementing _files_downloaded happens when _progress_callback is set. And made super() with no args. 2021-05-03 02:33:14 +04:00
e7cf2e7c4b
Added a missing return True statement in _check_file 2021-05-03 02:30:31 +04:00
503eb9959b
Version updated to 0.4.1. 2021-04-28 02:49:59 +04:00
93e442939a
Dvach's stickers handling. 2021-04-28 02:48:36 +04:00
6022c9929a
Added HTTP and URL exceptions handling. 2021-04-28 02:47:41 +04:00
986fdbe7a7 Handling of no arguments passed. 2020-11-19 01:30:47 +04:00
7b2fcf0899 Improved error handling, retries for damaged files. 2020-11-19 01:26:19 +04:00
b970973018 ConnectionResetError handling. 2020-11-19 00:09:39 +04:00
6dab626084 Version is changed to 0.4.0. 2020-11-18 23:51:18 +04:00
7754a90313 FileInfo is now a frozen dataclass for efficiency. 2020-11-18 23:48:38 +04:00
bb47b50c5f _is_file_ok now is _check_file and modified to be more efficient. Also added check for if files happened to share same name and size, but IB said wrong hash. 2020-11-18 23:47:26 +04:00
8403fcf0f2 Now op file is explicitly in utf-8. 2020-11-18 23:45:06 +04:00
647a787974 FIxed arguments for a match function. 2020-11-18 23:44:36 +04:00
6a54b88498 sub and com ->subject and comment. Fixed arguments for match function. 2020-11-18 23:43:43 +04:00
2043fc277f No right to fuck up! Shit... Forgot third part of a version. 2020-09-09 04:39:33 +04:00
a106d5b739 Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now. 2020-09-09 04:34:41 +04:00
7825b53121 Did a minor refactoring. Also combined two first lines that are printed for a thread into one. 2020-07-20 04:32:30 +04:00
b26152f3ca Moved User-Agent off to __init__ in its own variable. 2020-07-20 04:31:27 +04:00
2fcd4f0aa7 Updated usage, so I don't have to edit it every time I add a new IB. 2020-07-20 04:13:12 +04:00
520d88c76a Parser for 8kun.top added. And I changed compares in __init__. 2020-07-20 03:45:51 +04:00
93d2904a4f Regex limited to up to 4 characters after first dot occured. 2020-07-20 03:44:48 +04:00
6df9e573aa Updated version to 0.2.2 2020-07-20 03:43:36 +04:00
f21ff0aff5 Oh, fuck me. What a typo... xD 2020-07-20 02:55:54 +04:00
4db2e1dc75 A little change of output. 2020-07-18 05:04:06 +04:00
22961611da BasicScraper is replaced with a threaded one. Also OP's post handling altered. 2020-07-18 04:44:37 +04:00
195d4d057a Version is incremented now and I wrote down the changes. 2020-07-18 04:43:45 +04:00
87eecf0a09 New threaded scraper implemented. 2020-07-18 04:43:00 +04:00
3223c0721a Fixed OP's post property. Handled situation when comment and/or subject doesn't exists. 2020-07-18 04:42:19 +04:00
9a9aa8f714 Updated usage. 2020-07-08 23:13:17 +04:00
a5028162d8 Initial commit with all the files. 2020-07-08 22:53:39 +04:00