1
0
Commit Graph

48 Commits

Author SHA1 Message Date
f3ef07af68
Rewrite of Parser class because it was fucked up. Now there's no problems with inheritance and its subclasses now more pleasant to write. ThreadNotFoundError now has a reason field. 2021-05-03 02:38:46 +04:00
6373518dc3
Added order=True for FIleInfo to make sure that order of fields is preserved. 2021-05-03 02:36:17 +04:00
caf18a1bf0
Added option --skip-posts and messages are now takes just one line. 2021-05-03 02:35:31 +04:00
751549f575
A new generalised class for all imageboards based on Tinyboard or having identical API. 2021-05-03 02:34:38 +04:00
38b5740d73
Removing lolifox.cc parser because this board is dead. 2021-05-03 02:33:52 +04:00
2f9d26427c
Now incrementing _files_downloaded happens when _progress_callback is set. And made super() with no args. 2021-05-03 02:33:14 +04:00
e7cf2e7c4b
Added a missing return True statement in _check_file 2021-05-03 02:30:31 +04:00
4f6f56ae7b
Version in a Makefile is changed to 0.4.1. 2021-04-28 02:50:38 +04:00
503eb9959b
Version updated to 0.4.1. 2021-04-28 02:49:59 +04:00
cb2e0d77f7
Changelog update for 0.4.1. 2021-04-28 02:49:26 +04:00
93e442939a
Dvach's stickers handling. 2021-04-28 02:48:36 +04:00
6022c9929a
Added HTTP and URL exceptions handling. 2021-04-28 02:47:41 +04:00
f79abcc310 In classifiers licence was fixed and added more topics related to a program. 2020-11-25 03:37:24 +04:00
9cdb510325 A little fix for README. 2020-11-25 03:36:31 +04:00
986fdbe7a7 Handling of no arguments passed. 2020-11-19 01:30:47 +04:00
2e6352cb13 Updated changelog. 2020-11-19 01:26:35 +04:00
7b2fcf0899 Improved error handling, retries for damaged files. 2020-11-19 01:26:19 +04:00
21837c5335 Updated changelog. 2020-11-19 00:09:56 +04:00
b970973018 ConnectionResetError handling. 2020-11-19 00:09:39 +04:00
6dab626084 Version is changed to 0.4.0. 2020-11-18 23:51:18 +04:00
86b6278657 Updated changelog and readme. 2020-11-18 23:50:58 +04:00
7754a90313 FileInfo is now a frozen dataclass for efficiency. 2020-11-18 23:48:38 +04:00
bb47b50c5f _is_file_ok now is _check_file and modified to be more efficient. Also added check for if files happened to share same name and size, but IB said wrong hash. 2020-11-18 23:47:26 +04:00
8403fcf0f2 Now op file is explicitly in utf-8. 2020-11-18 23:45:06 +04:00
647a787974 FIxed arguments for a match function. 2020-11-18 23:44:36 +04:00
6a54b88498 sub and com ->subject and comment. Fixed arguments for match function. 2020-11-18 23:43:43 +04:00
2043fc277f No right to fuck up! Shit... Forgot third part of a version. 2020-09-09 04:39:33 +04:00
a106d5b739 Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now. 2020-09-09 04:34:41 +04:00
7825b53121 Did a minor refactoring. Also combined two first lines that are printed for a thread into one. 2020-07-20 04:32:30 +04:00
b26152f3ca Moved User-Agent off to __init__ in its own variable. 2020-07-20 04:31:27 +04:00
9ad9fcfd6f Added supported IBs to readme. 2020-07-20 04:13:39 +04:00
2fcd4f0aa7 Updated usage, so I don't have to edit it every time I add a new IB. 2020-07-20 04:13:12 +04:00
bfaa9d2778 Reduced summary. Changed URL. Edited keywords to actual domains. 2020-07-20 04:11:38 +04:00
371c6623e9 Updated changelog. 2020-07-20 03:51:41 +04:00
520d88c76a Parser for 8kun.top added. And I changed compares in __init__. 2020-07-20 03:45:51 +04:00
93d2904a4f Regex limited to up to 4 characters after first dot occured. 2020-07-20 03:44:48 +04:00
6df9e573aa Updated version to 0.2.2 2020-07-20 03:43:36 +04:00
f21ff0aff5 Oh, fuck me. What a typo... xD 2020-07-20 02:55:54 +04:00
c0282f3934 Changelog updated. 2020-07-18 05:10:31 +04:00
4db2e1dc75 A little change of output. 2020-07-18 05:04:06 +04:00
22961611da BasicScraper is replaced with a threaded one. Also OP's post handling altered. 2020-07-18 04:44:37 +04:00
195d4d057a Version is incremented now and I wrote down the changes. 2020-07-18 04:43:45 +04:00
87eecf0a09 New threaded scraper implemented. 2020-07-18 04:43:00 +04:00
3223c0721a Fixed OP's post property. Handled situation when comment and/or subject doesn't exists. 2020-07-18 04:42:19 +04:00
0ed1e896ca Updated README. 2020-07-08 23:13:32 +04:00
9a9aa8f714 Updated usage. 2020-07-08 23:13:17 +04:00
9fcb09f442 Fixed version of package. 2020-07-08 22:59:36 +04:00
a5028162d8 Initial commit with all the files. 2020-07-08 22:53:39 +04:00