Downloads and archives content from reddit

archive downloader gfycat imgur python reddit scraper

Go to file

Ali Parlakci fd507870e1 Added more information		2018-07-12 01:39:58 +03:00
docs	Added more information	2018-07-12 01:39:58 +03:00
src	Bug fix	2018-07-12 00:09:20 +03:00
_config.yml	Initial commit	2018-07-09 22:58:11 +03:00
.gitignore	Initial commit	2018-07-09 22:58:11 +03:00
LICENSE	Initial commit	2018-07-09 22:58:11 +03:00
README.md	Added more information	2018-07-12 01:39:58 +03:00
requirements.txt	Added requirements.txt	2018-07-11 23:55:03 +03:00
script.py	Update version	2018-07-12 00:00:39 +03:00

README.md

Bulk Downloader for Reddit

This program downloads imgur, gfycat and direct image and video links of saved posts from a reddit account. It is written in Python 3.

PLEASE post any issue you have with the script to Issues tab. Since I don't have any testers or contributers I need your feedback.

What can it do?

It...

can get posts from: frontpage, subreddits, multireddits, redditor's submissions, upvoted and saved posts; search results or just plain reddit links
sorts posts by hot, top, new and so on
downloads imgur albums, gfycat links, self posts and any link to a direct image
skips the existing ones
puts post titles to file's name
puts every post to its subreddit's folder
saves a reusable copy of posts' details that are found so that they can be re-downloaded again
logs failed ones in a file to so that you can try to download them later
can be run with double-clicking on Windows (but I don't recommend it)

Requirements

Python >3.6

You can install Python 3 here: https://www.python.org/downloads/

You have to check "Add Python 3 to PATH" option when installing in order it to run correctly.

Setting up the script

Because this is not a commercial app, you need to create an imgur developer app in order API to work.

Creating an imgur app

Go to https://api.imgur.com/oauth2/addclient
Enter a name into the Application Name field.
Pick Anonymous usage without user authorization as an Authorization type*
Enter your email into the Email field.
Correct CHAPTCHA
Click submit button

It should redirect to a page which shows your imgur_client_id and imgur_client_secret

* Select OAuth 2 authorization without a callback URL first then select Anonymous usage without user authorization if it says Authorization callback URL: required

Running the script

For Windows users, there is an EXE file to run easily. Linux and MacOS users have to run it from the source code through terminal.

To get further information about that and command-line arguments, see python script.py --help

FAQ

I can't open the self post files.

Self posts are held at reddit as styled with markdown. So, the script downloads them as they are in order not to lose their stylings. However, there is a great Chrome extension here for viewing Markdown files with its styling. Install it and open the files with Chrome.