|
|
419fb2b673
|
Removed excessive comparison of hash. Added message when file cannot be retrieved.
|
2021-05-04 03:56:59 +04:00 |
|
|
|
0287d3a132
|
Turned a string into f-string.
|
2021-05-04 03:55:32 +04:00 |
|
|
|
b335891097
|
Copyright, date, and version are updated.
|
2021-05-03 02:41:32 +04:00 |
|
|
|
1213cef776
|
Lolifox removed. Added skip_posts handling.
|
2021-05-03 02:40:57 +04:00 |
|
|
|
78d4a62c17
|
IB parsers rewritten accordingly to fixed Parser class.
|
2021-05-03 02:40:21 +04:00 |
|
|
|
f3ef07af68
|
Rewrite of Parser class because it was fucked up. Now there's no problems with inheritance and its subclasses now more pleasant to write. ThreadNotFoundError now has a reason field.
|
2021-05-03 02:38:46 +04:00 |
|
|
|
6373518dc3
|
Added order=True for FIleInfo to make sure that order of fields is preserved.
|
2021-05-03 02:36:17 +04:00 |
|
|
|
caf18a1bf0
|
Added option --skip-posts and messages are now takes just one line.
|
2021-05-03 02:35:31 +04:00 |
|
|
|
751549f575
|
A new generalised class for all imageboards based on Tinyboard or having identical API.
|
2021-05-03 02:34:38 +04:00 |
|
|
|
38b5740d73
|
Removing lolifox.cc parser because this board is dead.
|
2021-05-03 02:33:52 +04:00 |
|
|
|
2f9d26427c
|
Now incrementing _files_downloaded happens when _progress_callback is set. And made super() with no args.
|
2021-05-03 02:33:14 +04:00 |
|
|
|
e7cf2e7c4b
|
Added a missing return True statement in _check_file
|
2021-05-03 02:30:31 +04:00 |
|
|
|
503eb9959b
|
Version updated to 0.4.1.
|
2021-04-28 02:49:59 +04:00 |
|
|
|
93e442939a
|
Dvach's stickers handling.
|
2021-04-28 02:48:36 +04:00 |
|
|
|
6022c9929a
|
Added HTTP and URL exceptions handling.
|
2021-04-28 02:47:41 +04:00 |
|
|
|
986fdbe7a7
|
Handling of no arguments passed.
|
2020-11-19 01:30:47 +04:00 |
|
|
|
7b2fcf0899
|
Improved error handling, retries for damaged files.
|
2020-11-19 01:26:19 +04:00 |
|
|
|
b970973018
|
ConnectionResetError handling.
|
2020-11-19 00:09:39 +04:00 |
|
|
|
6dab626084
|
Version is changed to 0.4.0.
|
2020-11-18 23:51:18 +04:00 |
|
|
|
7754a90313
|
FileInfo is now a frozen dataclass for efficiency.
|
2020-11-18 23:48:38 +04:00 |
|
|
|
bb47b50c5f
|
_is_file_ok now is _check_file and modified to be more efficient. Also added check for if files happened to share same name and size, but IB said wrong hash.
|
2020-11-18 23:47:26 +04:00 |
|
|
|
8403fcf0f2
|
Now op file is explicitly in utf-8.
|
2020-11-18 23:45:06 +04:00 |
|
|
|
647a787974
|
FIxed arguments for a match function.
|
2020-11-18 23:44:36 +04:00 |
|
|
|
6a54b88498
|
sub and com ->subject and comment. Fixed arguments for match function.
|
2020-11-18 23:43:43 +04:00 |
|
|
|
2043fc277f
|
No right to fuck up! Shit... Forgot third part of a version.
|
2020-09-09 04:39:33 +04:00 |
|
|
|
a106d5b739
|
Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now.
|
2020-09-09 04:34:41 +04:00 |
|
|
|
7825b53121
|
Did a minor refactoring. Also combined two first lines that are printed for a thread into one.
|
2020-07-20 04:32:30 +04:00 |
|
|
|
b26152f3ca
|
Moved User-Agent off to __init__ in its own variable.
|
2020-07-20 04:31:27 +04:00 |
|
|
|
2fcd4f0aa7
|
Updated usage, so I don't have to edit it every time I add a new IB.
|
2020-07-20 04:13:12 +04:00 |
|
|
|
520d88c76a
|
Parser for 8kun.top added. And I changed compares in __init__.
|
2020-07-20 03:45:51 +04:00 |
|
|
|
93d2904a4f
|
Regex limited to up to 4 characters after first dot occured.
|
2020-07-20 03:44:48 +04:00 |
|
|
|
6df9e573aa
|
Updated version to 0.2.2
|
2020-07-20 03:43:36 +04:00 |
|
|
|
f21ff0aff5
|
Oh, fuck me. What a typo... xD
|
2020-07-20 02:55:54 +04:00 |
|
|
|
4db2e1dc75
|
A little change of output.
|
2020-07-18 05:04:06 +04:00 |
|
|
|
22961611da
|
BasicScraper is replaced with a threaded one. Also OP's post handling altered.
|
2020-07-18 04:44:37 +04:00 |
|
|
|
195d4d057a
|
Version is incremented now and I wrote down the changes.
|
2020-07-18 04:43:45 +04:00 |
|
|
|
87eecf0a09
|
New threaded scraper implemented.
|
2020-07-18 04:43:00 +04:00 |
|
|
|
3223c0721a
|
Fixed OP's post property. Handled situation when comment and/or subject doesn't exists.
|
2020-07-18 04:42:19 +04:00 |
|
|
|
9a9aa8f714
|
Updated usage.
|
2020-07-08 23:13:17 +04:00 |
|
|
|
a5028162d8
|
Initial commit with all the files.
|
2020-07-08 22:53:39 +04:00 |
|
