 Alexander Andreev
|
f3ef07af68
|
Rewrite of Parser class because it was fucked up. Now there's no problems with inheritance and its subclasses now more pleasant to write. ThreadNotFoundError now has a reason field.
|
2021-05-03 02:38:46 +04:00 |
|
Alexander Andreev
|
6373518dc3
|
Added order=True for FIleInfo to make sure that order of fields is preserved.
|
2021-05-03 02:36:17 +04:00 |
|
Alexander Andreev
|
caf18a1bf0
|
Added option --skip-posts and messages are now takes just one line.
|
2021-05-03 02:35:31 +04:00 |
|
Alexander Andreev
|
751549f575
|
A new generalised class for all imageboards based on Tinyboard or having identical API.
|
2021-05-03 02:34:38 +04:00 |
|
Alexander Andreev
|
38b5740d73
|
Removing lolifox.cc parser because this board is dead.
|
2021-05-03 02:33:52 +04:00 |
|
Alexander Andreev
|
2f9d26427c
|
Now incrementing _files_downloaded happens when _progress_callback is set. And made super() with no args.
|
2021-05-03 02:33:14 +04:00 |
|
Alexander Andreev
|
e7cf2e7c4b
|
Added a missing return True statement in _check_file
|
2021-05-03 02:30:31 +04:00 |
|
Alexander Andreev
|
4f6f56ae7b
|
Version in a Makefile is changed to 0.4.1.
|
2021-04-28 02:50:38 +04:00 |
|
Alexander Andreev
|
503eb9959b
|
Version updated to 0.4.1.
|
2021-04-28 02:49:59 +04:00 |
|
Alexander Andreev
|
cb2e0d77f7
|
Changelog update for 0.4.1.
|
2021-04-28 02:49:26 +04:00 |
|
Alexander Andreev
|
93e442939a
|
Dvach's stickers handling.
|
2021-04-28 02:48:36 +04:00 |
|
Alexander Andreev
|
6022c9929a
|
Added HTTP and URL exceptions handling.
|
2021-04-28 02:47:41 +04:00 |
|
Alexander Andreev
|
f79abcc310
|
In classifiers licence was fixed and added more topics related to a program.
|
2020-11-25 03:37:24 +04:00 |
|
Alexander Andreev
|
9cdb510325
|
A little fix for README.
|
2020-11-25 03:36:31 +04:00 |
|
Alexander Andreev
|
986fdbe7a7
|
Handling of no arguments passed.
|
2020-11-19 01:30:47 +04:00 |
|
Alexander Andreev
|
2e6352cb13
|
Updated changelog.
|
2020-11-19 01:26:35 +04:00 |
|
Alexander Andreev
|
7b2fcf0899
|
Improved error handling, retries for damaged files.
|
2020-11-19 01:26:19 +04:00 |
|
Alexander Andreev
|
21837c5335
|
Updated changelog.
|
2020-11-19 00:09:56 +04:00 |
|
Alexander Andreev
|
b970973018
|
ConnectionResetError handling.
|
2020-11-19 00:09:39 +04:00 |
|
Alexander Andreev
|
6dab626084
|
Version is changed to 0.4.0.
|
2020-11-18 23:51:18 +04:00 |
|
Alexander Andreev
|
86b6278657
|
Updated changelog and readme.
|
2020-11-18 23:50:58 +04:00 |
|
Alexander Andreev
|
7754a90313
|
FileInfo is now a frozen dataclass for efficiency.
|
2020-11-18 23:48:38 +04:00 |
|
Alexander Andreev
|
bb47b50c5f
|
_is_file_ok now is _check_file and modified to be more efficient. Also added check for if files happened to share same name and size, but IB said wrong hash.
|
2020-11-18 23:47:26 +04:00 |
|
Alexander Andreev
|
8403fcf0f2
|
Now op file is explicitly in utf-8.
|
2020-11-18 23:45:06 +04:00 |
|
Alexander Andreev
|
647a787974
|
FIxed arguments for a match function.
|
2020-11-18 23:44:36 +04:00 |
|
Alexander Andreev
|
6a54b88498
|
sub and com ->subject and comment. Fixed arguments for match function.
|
2020-11-18 23:43:43 +04:00 |
|
Alexander Andreev
|
2043fc277f
|
No right to fuck up! Shit... Forgot third part of a version.
|
2020-09-09 04:39:33 +04:00 |
|
Alexander Andreev
|
a106d5b739
|
Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now.
|
2020-09-09 04:34:41 +04:00 |
|
Alexander Andreev
|
7825b53121
|
Did a minor refactoring. Also combined two first lines that are printed for a thread into one.
|
2020-07-20 04:32:30 +04:00 |
|
Alexander Andreev
|
b26152f3ca
|
Moved User-Agent off to __init__ in its own variable.
|
2020-07-20 04:31:27 +04:00 |
|
Alexander Andreev
|
9ad9fcfd6f
|
Added supported IBs to readme.
|
2020-07-20 04:13:39 +04:00 |
|
Alexander Andreev
|
2fcd4f0aa7
|
Updated usage, so I don't have to edit it every time I add a new IB.
|
2020-07-20 04:13:12 +04:00 |
|
Alexander Andreev
|
bfaa9d2778
|
Reduced summary. Changed URL. Edited keywords to actual domains.
|
2020-07-20 04:11:38 +04:00 |
|
Alexander Andreev
|
371c6623e9
|
Updated changelog.
|
2020-07-20 03:51:41 +04:00 |
|
Alexander Andreev
|
520d88c76a
|
Parser for 8kun.top added. And I changed compares in __init__.
|
2020-07-20 03:45:51 +04:00 |
|
Alexander Andreev
|
93d2904a4f
|
Regex limited to up to 4 characters after first dot occured.
|
2020-07-20 03:44:48 +04:00 |
|
Alexander Andreev
|
6df9e573aa
|
Updated version to 0.2.2
|
2020-07-20 03:43:36 +04:00 |
|
Alexander Andreev
|
f21ff0aff5
|
Oh, fuck me. What a typo... xD
|
2020-07-20 02:55:54 +04:00 |
|
Alexander Andreev
|
c0282f3934
|
Changelog updated.
|
2020-07-18 05:10:31 +04:00 |
|
Alexander Andreev
|
4db2e1dc75
|
A little change of output.
|
2020-07-18 05:04:06 +04:00 |
|
Alexander Andreev
|
22961611da
|
BasicScraper is replaced with a threaded one. Also OP's post handling altered.
|
2020-07-18 04:44:37 +04:00 |
|
Alexander Andreev
|
195d4d057a
|
Version is incremented now and I wrote down the changes.
|
2020-07-18 04:43:45 +04:00 |
|
Alexander Andreev
|
87eecf0a09
|
New threaded scraper implemented.
|
2020-07-18 04:43:00 +04:00 |
|
Alexander Andreev
|
3223c0721a
|
Fixed OP's post property. Handled situation when comment and/or subject doesn't exists.
|
2020-07-18 04:42:19 +04:00 |
|
Alexander Andreev
|
0ed1e896ca
|
Updated README.
|
2020-07-08 23:13:32 +04:00 |
|
Alexander Andreev
|
9a9aa8f714
|
Updated usage.
|
2020-07-08 23:13:17 +04:00 |
|
Alexander Andreev
|
9fcb09f442
|
Fixed version of package.
|
2020-07-08 22:59:36 +04:00 |
|
Alexander Andreev
|
a5028162d8
|
Initial commit with all the files.
|
2020-07-08 22:53:39 +04:00 |