1
0
Commit Graph

49 Commits

Author SHA1 Message Date
78d4a62c17
IB parsers rewritten accordingly to fixed Parser class. 2021-05-03 02:40:21 +04:00
f3ef07af68
Rewrite of Parser class because it was fucked up. Now there's no problems with inheritance and its subclasses now more pleasant to write. ThreadNotFoundError now has a reason field. 2021-05-03 02:38:46 +04:00
6373518dc3
Added order=True for FIleInfo to make sure that order of fields is preserved. 2021-05-03 02:36:17 +04:00
caf18a1bf0
Added option --skip-posts and messages are now takes just one line. 2021-05-03 02:35:31 +04:00
751549f575
A new generalised class for all imageboards based on Tinyboard or having identical API. 2021-05-03 02:34:38 +04:00
38b5740d73
Removing lolifox.cc parser because this board is dead. 2021-05-03 02:33:52 +04:00
2f9d26427c
Now incrementing _files_downloaded happens when _progress_callback is set. And made super() with no args. 2021-05-03 02:33:14 +04:00
e7cf2e7c4b
Added a missing return True statement in _check_file 2021-05-03 02:30:31 +04:00
4f6f56ae7b
Version in a Makefile is changed to 0.4.1. 2021-04-28 02:50:38 +04:00
503eb9959b
Version updated to 0.4.1. 2021-04-28 02:49:59 +04:00
cb2e0d77f7
Changelog update for 0.4.1. 2021-04-28 02:49:26 +04:00
93e442939a
Dvach's stickers handling. 2021-04-28 02:48:36 +04:00
6022c9929a
Added HTTP and URL exceptions handling. 2021-04-28 02:47:41 +04:00
f79abcc310 In classifiers licence was fixed and added more topics related to a program. 2020-11-25 03:37:24 +04:00
9cdb510325 A little fix for README. 2020-11-25 03:36:31 +04:00
986fdbe7a7 Handling of no arguments passed. 2020-11-19 01:30:47 +04:00
2e6352cb13 Updated changelog. 2020-11-19 01:26:35 +04:00
7b2fcf0899 Improved error handling, retries for damaged files. 2020-11-19 01:26:19 +04:00
21837c5335 Updated changelog. 2020-11-19 00:09:56 +04:00
b970973018 ConnectionResetError handling. 2020-11-19 00:09:39 +04:00
6dab626084 Version is changed to 0.4.0. 2020-11-18 23:51:18 +04:00
86b6278657 Updated changelog and readme. 2020-11-18 23:50:58 +04:00
7754a90313 FileInfo is now a frozen dataclass for efficiency. 2020-11-18 23:48:38 +04:00
bb47b50c5f _is_file_ok now is _check_file and modified to be more efficient. Also added check for if files happened to share same name and size, but IB said wrong hash. 2020-11-18 23:47:26 +04:00
8403fcf0f2 Now op file is explicitly in utf-8. 2020-11-18 23:45:06 +04:00
647a787974 FIxed arguments for a match function. 2020-11-18 23:44:36 +04:00
6a54b88498 sub and com ->subject and comment. Fixed arguments for match function. 2020-11-18 23:43:43 +04:00
2043fc277f No right to fuck up! Shit... Forgot third part of a version. 2020-09-09 04:39:33 +04:00
a106d5b739 Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now. 2020-09-09 04:34:41 +04:00
7825b53121 Did a minor refactoring. Also combined two first lines that are printed for a thread into one. 2020-07-20 04:32:30 +04:00
b26152f3ca Moved User-Agent off to __init__ in its own variable. 2020-07-20 04:31:27 +04:00
9ad9fcfd6f Added supported IBs to readme. 2020-07-20 04:13:39 +04:00
2fcd4f0aa7 Updated usage, so I don't have to edit it every time I add a new IB. 2020-07-20 04:13:12 +04:00
bfaa9d2778 Reduced summary. Changed URL. Edited keywords to actual domains. 2020-07-20 04:11:38 +04:00
371c6623e9 Updated changelog. 2020-07-20 03:51:41 +04:00
520d88c76a Parser for 8kun.top added. And I changed compares in __init__. 2020-07-20 03:45:51 +04:00
93d2904a4f Regex limited to up to 4 characters after first dot occured. 2020-07-20 03:44:48 +04:00
6df9e573aa Updated version to 0.2.2 2020-07-20 03:43:36 +04:00
f21ff0aff5 Oh, fuck me. What a typo... xD 2020-07-20 02:55:54 +04:00
c0282f3934 Changelog updated. 2020-07-18 05:10:31 +04:00
4db2e1dc75 A little change of output. 2020-07-18 05:04:06 +04:00
22961611da BasicScraper is replaced with a threaded one. Also OP's post handling altered. 2020-07-18 04:44:37 +04:00
195d4d057a Version is incremented now and I wrote down the changes. 2020-07-18 04:43:45 +04:00
87eecf0a09 New threaded scraper implemented. 2020-07-18 04:43:00 +04:00
3223c0721a Fixed OP's post property. Handled situation when comment and/or subject doesn't exists. 2020-07-18 04:42:19 +04:00
0ed1e896ca Updated README. 2020-07-08 23:13:32 +04:00
9a9aa8f714 Updated usage. 2020-07-08 23:13:17 +04:00
9fcb09f442 Fixed version of package. 2020-07-08 22:59:36 +04:00
a5028162d8 Initial commit with all the files. 2020-07-08 22:53:39 +04:00