Spider/bulk-downloader-for-reddit
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,100 Commits 2 Branches 45 Tags 14 MiB
271da4e6f3
Commit Graph

200 Commits

Author SHA1 Message Date
OMEGA_RAZER
954df88c86
Merge branch 'aliparlakci:development' into development 2023-01-01 06:51:47 -05:00
Serene
b7aae727e5
Merge pull request #738 from Soulsuck24/development 2023-01-01 19:59:52 +10:00
OMEGARAZER
b6edc36753
Update connector for 7 digit ID's 2023-01-01 04:09:11 -05:00
Soulsuck24
874c7e3117
Redgif fixes 
Missing half of #733
 2022-12-31 08:53:13 -05:00
OMEGARAZER
2bafb1b99b
Consolidate flake8 settings 
Consolidates sane flake8 settings to pyproject with the Flake8-pyproject plugin.

Does not change logic of test workflow but allows base settings to live in pyproject for anyone using flake8 as an external linter (e.g. vscode)

Also fixes some flake8 errors that were not being picked up by current testing, mostly unused imports.
 2022-12-28 10:00:43 -05:00
Soulsuck24
13887ca7e1
Redgif updates 
Coverage for direct links.

The direct link won't work because it will have the wrong auth anyway but this will at least end up with the right API call.
 2022-12-26 20:25:20 -05:00
Soulsuck24
fe9cc7f29f
Redgifs updates 
Update Redgifs regex for further edge case.

Add test for checking ID.
 2022-12-24 20:52:45 -05:00
OMEGA_RAZER
e92929ef07
Merge branch 'aliparlakci:development' into completion 2022-12-22 23:46:06 -05:00
Serene
c63a8842d9
Merge pull request #729 from OMEGARAZER/development 2022-12-22 18:11:16 +10:00
OMEGARAZER
2aea7d0d48
Move completion to pathlib 2022-12-20 13:05:50 -05:00
OMEGARAZER
57ac0130a6
revert init files 2022-12-20 12:16:31 -05:00
OMEGA_RAZER
da74096cde
Update test_download_factory.py 2022-12-19 22:04:49 -05:00
Serene
8d43cdeef7
Merge pull request #726 from Soulsuck24/development 2022-12-20 10:28:10 +10:00
OMEGARAZER
83f45e7f60
Standardize shebang and coding declaration 
Standardizes shebang and coding declarations.

Coding matches what's used by install tools such as pip(x).

Removes a few init files that were not needed.
 2022-12-19 18:32:37 -05:00
OMEGARAZER
5d3a539eda
Fix install of completion if dirs missing 
Fixes situations if completion directories are missing and adds tests for installer.
 2022-12-19 17:54:34 -05:00
Soulsuck24
603e7de04d
Redgifs fix 
Handle redgifs link with trailing / causing id to return empty string.
 2022-12-19 11:02:06 -05:00
OMEGARAZER
af6222e06c
Cleanup tests 
Cleans up test args on new tests.

Add log path to default config test so as not to mangle default log outside of tests.

Match setup functions to archive/clone.

Remove testing marker that was commited in error.
 2022-12-17 20:35:58 -05:00
Serene
58e1d1a8f9
Merge pull request #713 from OMEGARAZER/development 2022-12-16 10:59:35 +10:00
OMEGARAZER
4ba5df6b37
5xx error tests 2022-12-14 23:19:15 -05:00
Soulsuck24
15a9d25a9d
Imgur webp coverage 
update regex to catch _d in webp links from imgur.
 2022-12-11 14:20:04 -05:00
OMEGARAZER
d4bfe8fa19
Formatting cleanup 
Cleanup some formatting from switch to Black
 2022-12-03 14:49:39 -05:00
Serene-Arc
0873a4a2b2 Format according to the black standard 2022-12-03 15:11:17 +10:00
OMEGARAZER
b30ced9be9
Redo Pylance typing changes 2022-11-30 21:48:10 -05:00
Serene
45429be27c
Revert "Pylance typing" 2022-12-01 12:37:03 +10:00
OMEGARAZER
69fa1f3f09
Pylance typing 
Fix Pylance warnings for typing
 2022-11-30 21:29:07 -05:00
OMEGARAZER
ef7fcce1cc
lint tests 
Lint with [refurb](https://github.com/dosisod/refurb) using `--disable 126 --python-version 3.9`

Also update bats to 1.8.2 and bats-assets to 2.1.0. No changes to the tests, all still passing.
 2022-11-30 18:05:10 -05:00
Soulsuck24
48c96beba2
Redgifs improvements 
Add check to verify token was received.
Update headers sent to content API.

Add availability check for videos to resolve last part of #472 where only SD version is available.
 2022-11-27 18:07:43 -05:00
OMEGARAZER
9ee13aea23
Update tests 
Suspended user in two tests.

Updated hashes and yt-dlp version.

Removed success check on known failure.
 2022-11-26 14:36:19 -05:00
Serene-Arc
87104e7e6a Catch exceptions in cloner 2022-11-24 10:48:17 +10:00
OMEGARAZER
42416db8b9
Fix PRAW deprecations 
Fix depreciations in MultiredditHelper and CommentForest.
 2022-11-21 21:37:59 -05:00
Serene-Arc
4143c53ff1 Add tests 2022-11-21 15:47:13 +10:00
Serene-Arc
1385545e26 Add tests for downloader 2022-11-21 14:35:57 +10:00
OMEGA_RAZER
0a586425d0
Merge branch 'aliparlakci:development' into DelayForReddit 2022-11-11 17:38:16 -05:00
OMEGARAZER
f3c7d796aa
Update for other failing tests 
Seems there was some overlap in test names that was contributing to the test errors. Updated hash and test name.
 2022-11-08 15:37:21 -05:00
OMEGARAZER
77711c243a
Fix test for deleted user on post 
tested post now showing deleted as user causing tests to fail. Updated to working post.
 2022-11-08 13:54:18 -05:00
OMEGARAZER
dfc21295e3
Add Delay for Reddit support 
Adds support for delayforreddit.com non-direct links.
 2022-11-05 10:51:33 -04:00
Serene
3d0ac9e483
Merge pull request #671 from OMEGARAZER/development 2022-09-30 19:08:01 +10:00
Serene-Arc
14e98f014b Add test cases 2022-09-29 18:18:44 +10:00
OMEGARAZER
b536a486b6
Imgur argument tests 
Add tests for links that have arguments added to the extension field in retrieved image_dict
 2022-09-28 13:21:05 -04:00
OMEGARAZER
02b6e66941
Imgur edge case coverage 
Covers edge case of additional arguments on extension.

Also removed duplicate or redundant tests.
 2022-09-28 00:55:10 -04:00
Serene-Arc
0ce2585f7f Update path so tests do not skip 2022-09-27 10:59:39 +10:00
Serene-Arc
b7d21161fb Update test 2022-09-27 10:53:12 +10:00
Serene-Arc
3b5f8bca67 Update hashes 2022-09-24 09:46:05 +10:00
Serene-Arc
c834314086 Update hash 2022-09-24 09:46:05 +10:00
Serene-Arc
7bb2a9adbb Remove obsolete test 2022-09-24 09:46:05 +10:00
Serene-Arc
57e59db458 Update Erome link regex 2022-09-24 09:46:05 +10:00
OMEGARAZER
ca33dee265
Update test_download_integration.py 
The old change twice forget once. Forgot I changed it back to a SelfPost rather than Direct.
 2022-09-23 10:00:41 -04:00
OMEGARAZER
9c067ad74f
Update test_connector.py 
Update user that was banned/suspended with one that should not end up that way.
 2022-09-23 02:59:16 -04:00
OMEGARAZER
3906386838
Update test_download_integration.py 
Update broken ID's in download integration test
 2022-09-23 02:57:43 -04:00
OMEGARAZER
7fef6c4023
Update test_clone_integration.py 
Update broken ID's in clone integration test
 2022-09-23 02:51:53 -04:00