Downloads and archives content from reddit

archive downloader gfycat imgur python reddit scraper

Go to file

Ali Parlakci 4daa9cd66a Initial commit		2018-07-11 23:24:36 +03:00
docs	Initial commit	2018-07-11 23:24:36 +03:00
src	Adding error tracebacks to CONSOLE_LOG files	2018-07-11 22:27:48 +03:00
_config.yml	Initial commit	2018-07-09 22:58:11 +03:00
.gitignore	Initial commit	2018-07-09 22:58:11 +03:00
LICENSE	Initial commit	2018-07-09 22:58:11 +03:00
README.md	Strip down	2018-07-11 23:23:55 +03:00
script.py	Added clarifcation to log mode	2018-07-11 23:24:15 +03:00

README.md

Bulk Downloader for Reddit

This program downloads imgur, gfycat and direct image and video links of saved posts from a reddit account. It is written in Python 3.

PLEASE post any issue you have with the script to Issues tab. Since I don't have any testers or contributers I need your feedback.

What it can do?

It...

can get posts from: frontpage, subreddits, multireddits, redditor's submissions, upvoted and saved posts; search results or just plain reddit links
sorts posts by hot, top, new and so on
downloads imgur albums, gfycat links, self posts and any link to a direct image
skips the existing ones
puts post titles to file's name
puts every post to its subreddit's folder
saves a reusable copy of posts' details that are found so that they can be re-downloaded again
logs failed ones in a file to so that you can try to download them later
can be run with double-clicking on Windows (but I don't recommend it)

Requirements

Python >3.6

You can install Python 3 here: https://www.python.org/downloads/

You have to check "Add Python 3 to PATH" option when installing in order it to run correctly.

Setting up the script

Because this is not a commercial app, you need to create an imgur developer app in order API to work.

Creating an imgur app

Go to https://api.imgur.com/oauth2/addclient
Enter a name into the Application Name field.
Pick Anonymous usage without user authorization as an Authorization type*
Enter your email into the Email field.
Correct CHAPTCHA
Click submit button

It should redirect to a page which shows your imgur_client_id and imgur_client_secret

* Select OAuth 2 authorization without a callback URL first then select Anonymous usage without user authorization if it says Authorization callback URL: required

Running the script with command line arguments

See python script.py --help

FAQ

I can't open the self post files.

Self posts are held at reddit as styled with markdown. So, the script downloads them as they are in order not to lose their stylings. However, there is a great Chrome extension here for viewing Markdown files with its styling. Install it and open the files with Chrome.