ComicDownloader - Downloads Comics from readcomiconline.li

Overview

ComicDownloader

Downloads Comics from readcomiconline.li

To use this script from command line:

Setup

To ensure all run requirements are met, please do the following:

  • install python3.6 or greater (python3.8 is recommended)
  • run pip install -r requirements.txt

Usage:

./comicScraper.py
usage: comicScraper.py [-h] [-f FOLDER] [-v] [-c] [-l] [-d] URL

Script for downloading CBZ files from readcomiconline.li, version 0.1.12

positional arguments:
  URL                   The url of the comic to download

optional arguments:
  -h, --help            show this help message and exit
  -f FOLDER, --folder FOLDER
                        The folder to save the comic in
  -v, --version         Display the current version of the script
  -c, --complete        Download the entire comic into one folder. Omit this argument to download
                        each issue into its own folder
  -l, --lowres          Download low resolution images. Omit this argument to download the max
                        quality images
  -d, --disable-wait    Disable the wait between requests (captcha guard)
  -s, --selenium        Scrape image links using Selenium and a headless browser
  -sd, --selenium-display 
                        Use Selenium in display mode 
  -i, -issue            Pass this argument when you want to start your download at a specific issue number. 
                        For example, if the script crashes after downloading 100 out of 150 issues, start the script again and pass in -i, then input 100 when prompted. 
                        It should only download the remaining 50.

Example: comicScraper.py https://readcomiconline.li/Comic/Sandman-Presents-Lucifer
- Generates title for you, creates a folder and cbz file for each issue separately
Example: comicScraper.py https://readcomiconline.li/Comic/Sandman-Presents-Lucifer -c
- Generates title for you, creates one large folder with every image in it, and one large cbz
Example: comicScraper.py https://readcomiconline.li/Comic/Sandman-Presents-Lucifer -f Lucifer -c
- Uses title "Lucifer", creates one large folder with every image in it, and one large cbz
Example: comicScraper.py https://readcomiconline.li/Comic/1000-Storms/Issue-4?id=186482
- Generates title for you, detects that a single issue link has been provided
Example: comicScraper.py https://readcomiconline.li/Comic/Fables -l -d -sd
- Generates title for you, disables wait timer, downloads low(er) quality images, uses Selenium in display mode, downloads each issue into separate folders and CBZ files

Notes: This script will create a folder in the current directory (directory the script is run from) with the name of your comic. The name of the subdirectory is denoted by the -f / --folder flag.

The script will download comics to the current working directory, this means the script can be added to the PATH variable without issue. Example:

cd /tmp/comics && $HOME/ComicDownloader/comicScraper.py 
   
    
# this will download the images and comics to the /tmp/comics directory

   

This folder will then be filled with sequential images consisting of every image in every issue, in order.

The url parameter may be either the information page for the comic as a whole, or the url for a single issue.

Providing the -c argument will have no effect if you have supplied the link for a single issue.

Comments
  • Linux Python issue

    Linux Python issue

    OS: Linux LMDE4 Python 3.7.3

    Unfortunately can't get your new script to run :( My system is saying Python is up to date, but getting the errors below. So putting this out there now while I look into it to document and to see if any one else has a fix in the mean time.

    ./comicScraper.py https://readcomiconline.li/Comic/The-Superior-Foes-of-Spider-Man/Issue-7?id=2109 /usr/lib/python3/dist-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.26.7) or chardet (3.0.4) doesn't match a supported version! RequestsDependencyWarning) ComicScraper v0.1.14 You have provided the link for a single issue. When providing the URL for the info page, this script will download all issues in the series. No title specified. Reading title from Url... Using title: The-Superior-Foes-of-Spider-Man-Issue-7 Downloading max quality images Starting to scrape The-Superior-Foes-of-Spider-Man-Issue-7 from https://readcomiconline.li/Comic/The-Superior-Foes-of-Spider-Man/Issue-7?id=2109 Number of Issues to download 1 Issues to download: ['&readType=1'] Downloading Issue &readType=1 Traceback (most recent call last): File "./comicScraper.py", line 607, in <module> main(downloadFull, singleIssue, comicTitle, lowres, disableWait, startURL, useSelenium, seleniumDisplay, issueStart) File "./comicScraper.py", line 482, in main imageLinks, issueImageDict = downloadAllWithRequests(fullComicDownload, startURL, issueLinks, title, singleIssueDownload, disableWait) File "./comicScraper.py", line 438, in downloadAllWithRequests path = saveImagesFromImageLinks(issueImageDict[issueName], len(issueImageDict[issueName]), issueName) KeyError: '&readType=1'

    Beautifulsoup error...

    sudo pip install -r requirements.txt Collecting beautifulsoup4==4.10.0 (from -r requirements.txt (line 1)) Could not find a version that satisfies the requirement beautifulsoup4==4.10.0

    opened by ObiSandwich 13
  • Complete without CBZ?

    Complete without CBZ?

    Some of the comics to download include TPB or annuals, that either need to be deleted or have a separate CBZ. In this instance the auto CBZ is redundant and deleted. So, would it make sense to have an extra Complete argument that didn't include the CBZ?

    opened by ObiSandwich 1
  • Update of requirements file

    Update of requirements file

    requirements.txt has been updated to only include the base packages needed. Links to python virtual environments have been added to the README, information on how to use those environments with this project has not been included.

    opened by AustinHunting 0
  • Not working:

    Not working: "UnboundLocalError" ??

    Hey! Not sure if you guys are still supporting this, but I do hope you come back! Been a few months since I last ran the script, but somethings broken :( Any one else got this working?

    Tested a few times with the same results - most of the time nothing downloads with this error;

    ./comicScraper.py https://readcomiconline.li/Comic/Marjorie-Finnegan-Temporal-Criminal
    
    ComicScraper v0.1.14 
    
    No title specified. Reading title from Url...
    Using title: Marjorie-Finnegan-Temporal-Criminal
    Downloading max quality images
    Starting to scrape Marjorie-Finnegan-Temporal-Criminal from https://readcomiconline.li/Comic/Marjorie-Finnegan-Temporal-Criminal
    Number of Issues to download 8
    
    Issues to download: 
    ['Issue-1', 'Issue-2', 'Issue-3', 'Issue-4', 'Issue-5', 'Issue-6', 'Issue-7', 'Issue-8']
    Downloading Issue Issue-1
    Downloading images...
    Traceback (most recent call last):
      File "./comicScraper.py", line 626, in <module>
        main(downloadFull, singleIssue, comicTitle, lowres, disableWait, startURL, useSelenium, seleniumDisplay, issueStart)
      File "./comicScraper.py", line 501, in main
        imageLinks, issueImageDict = downloadAllWithRequests(fullComicDownload, startURL, issueLinks, title, singleIssueDownload, disableWait)
      File "./comicScraper.py", line 456, in downloadAllWithRequests
        path = saveImagesFromImageLinks(issueImageDict[issueName], len(issueImageDict[issueName]), issueName)
      File "./comicScraper.py", line 302, in saveImagesFromImageLinks
        displayDownloadInfo(path)
    UnboundLocalError: local variable 'path' referenced before assignment
    
    

    Or this happens - only the Comic Series Thumbnail downloads, nothing else;

    ./comicScraper.py https://readcomiconline.li/Comic/Bob-s-Burgers-2014
    
    ComicScraper v0.1.14 
    
    No title specified. Reading title from Url...
    Using title: Bob-s-Burgers-2014
    Downloading max quality images
    Starting to scrape Bob-s-Burgers-2014 from https://readcomiconline.li/Comic/Bob-s-Burgers-2014
    Number of Issues to download 5
    
    Issues to download: 
    ['Issue-1', 'Issue-2', 'Issue-3', 'Issue-4', 'Issue-5']
    Downloading Issue Issue-1
    Downloading images...
    Downloaded 1 files to /home/aaa/Downloads/- COMICS/ComicDownloader-main/Bob-s-Burgers-2014/Issue-1/
    Total size of files: 32.353kb
    Average file size: 32.353kb
    All files are larger than 10kb - good to go!
    Sleeping for 15 seconds
    Downloading Issue Issue-2
    Downloading images...
    Downloaded 1 files to /home/aaa/Downloads/- COMICS/ComicDownloader-main/Bob-s-Burgers-2014/Issue-2/
    Total size of files: 32.353kb
    Average file size: 32.353kb
    All files are larger than 10kb - good to go!
    Sleeping for 12 seconds
    Downloading Issue Issue-3
    Downloading images...
    Downloaded 1 files to /home/aaa/Downloads/- COMICS/ComicDownloader-main/Bob-s-Burgers-2014/Issue-3/
    Total size of files: 32.353kb
    Average file size: 32.353kb
    All files are larger than 10kb - good to go!
    Sleeping for 10 seconds
    Downloading Issue Issue-4
    Downloading images...
    Downloaded 1 files to /home/aaa/Downloads/- COMICS/ComicDownloader-main/Bob-s-Burgers-2014/Issue-4/
    Total size of files: 32.353kb
    Average file size: 32.353kb
    All files are larger than 10kb - good to go!
    Sleeping for 20 seconds
    Downloading Issue Issue-5
    Downloading images...
    Downloaded 1 files to /home/aaa/Downloads/- COMICS/ComicDownloader-main/Bob-s-Burgers-2014/Issue-5/
    Total size of files: 32.353kb
    Average file size: 32.353kb
    All files are larger than 10kb - good to go!
    Sleeping for 20 seconds
    Number of issues to download 5 
    
    Number of images to download: 
    5
    
    There was an error downloading ['Bob-s-Burgers-2014-Issue-1', 'Bob-s-Burgers-2014-Issue-2', 'Bob-s-Burgers-2014-Issue-3', 'Bob-s-Burgers-2014-Issue-4', 'Bob-s-Burgers-2014-Issue-5']
    
    Downloaded:
    Comics have been moved to Bob-s-Burgers-2014/CBZ_Files
    
    opened by ObiSandwich 0
  • CBZ Compression?

    CBZ Compression?

    Just did a quick test with Quantum-and-Woody-2013-Issue-01.cbz. The auto generated CBZ from the download size is: 51.9MB

    My local zip to CBZ (zero compression) using -0 gave me a file size of: 53.1MB

    For the highest quality, I prefer no compression in my CBZ's.

    So is the script compressing?

    opened by ObiSandwich 0
  • Unwanted Comic Series Thumbnail?

    Unwanted Comic Series Thumbnail?

    Strange thing going on with only some comics, where the Comic Series Thumbnail is included in the download - per issue, eg...

    Screenshot from 2022-01-30 14-33-35

    ./comicScraper.py https://readcomiconline.li/Comic/Quantum-and-Woody-2013

    ./comicScraper.py https://readcomiconline.li/https://readcomiconline.li/Comic/Star-Wars-2015 -c

    So for the Complete downloads, it's just a case of deleting the multiple unwanted comic series thumbnails. But the standard download of all issues to cbz is a pain, as all the cbz's have the same cover - eg...

    Screenshot from 2022-01-30 14-42-45

    opened by ObiSandwich 0
Owner
null
ImageScraper is a cross-platform tool for downloading a specified count from xkcd, Astronomy Picture of the Day and Existential Comics

ImageScraper The ImageScraper is a cross-platform tool for downloading a specified count from xkcd, Astronomy Picture of the Day and Existential Comic

1amnobody 1 Jan 25, 2022
FireDM is a python open source (Internet Download Manager) with multi-connections, high speed engine, it downloads general files and videos from youtube and tons of other streaming websites .

python open source (Internet Download Manager) with multi-connections, high speed engine, based on python, LibCurl, and youtube_dl https://github.com/firedm/FireDM

null 1.6k Apr 12, 2022
Python Program that downloads gaming required packages based on your Linux Distribution.

LibreGaming Python Program that downloads gaming required packages based on your Linux Distribution. Table of contents Distributions Prerequisites Dep

Ahmed Al Balochi 190 Sep 15, 2022
Download Apple Music Cover Artwork in the best Quality by providing an Apple Music Link. It downloads the jpg, png and webp version since they often differ from another.

amogus.py - Version 0.0.5 amogus - Apple Music Hi-Res Artwork Fetcher this is my first real python tool so sorry if its bad amogus is a Python script

reaper 40 Sep 15, 2022
PyDownloader - Downloads files and folders at high speed (based on your interent speed).

PyDownloader - Downloads files and folders at high speed (based on your interent speed).

Armen._.G 4 Feb 24, 2022
Downloads and Updates GOG Galaxy 2.0 Plugins/Integrations

GOG Galaxy Plugins Downloader Summary This program downloads GOG Galaxy 2.0 Plugins and installs them to the proper location. You probably do not want

slashbunny 246 Sep 28, 2022
Organize your downloads easily with DownloadOrganizer

DownloadOrganizer Organize your downloads organize your downloads easily with DownloadOrganizer Instilation how to install DownloadOrganizer Method 1:

null 1 Dec 2, 2021
Downloads .ksy files and their dependencies straight from the official kaitai-struct format gallery.

ksy-dl Downloads .ksy files and their dependencies straight from the official kaitai-struct format gallery. This tool will: Fetch any of the official

null 3 Jun 20, 2022
A script that downloads YouTube videos/audio

YouTube-Downloader A script that downloads YouTube videos/audio from youtube. Usage Download the script by executing the following in your terminal :

Debayan Sarkar 2 Jan 4, 2022
A program which takes an Anime name or URL and downloads the specified range of episodes.

super-anime-downloader A console application written in Python3.x (GUI will be added soon) which takes a Anime Name/URL as input and downloads the ran

Sayyid Ali Sajjad Rizavi 26 Jul 18, 2022
Downloads files and folders

PyDownloader Downloads files and folders at high speed (based on your interent speed). This is very useful to transfer big files from one computer to

ArmenG 4 Feb 24, 2022
Downloads photos you saved from a specific profile.

instagram-download-saved A python script that downloads photos you saved from a specific profile. The only dependency is instaloader, an open-source p

Aviv 1 Dec 19, 2021
Python script to automate youtube-dl downloads

Automated Download Tool !! Project status I am writing a new version of this program, which will solve several errors. The new version only supports G

Devil64-Dev 21 Sep 22, 2022
Tool To Get Downloads up to 4k from Paramount+

Paramount 4K Downloader Tool To Get Downloads up to 4k from Paramount+ ?? Hello Fellow < Developers/ >! Hi! My name is WVDUMP. I am Leaking the script

null 2 Dec 25, 2021
A python scripts that downloads doujin from nhentai without having an account

nhentai-downloader a python scripts that downloads doujin from https://nhentai.net without having an account. Usage Needs Python 3^ Linux pip3 install

Earl Sabalo 4 Jun 13, 2022
Simple tool downloads public PoC (refer from nomi-sec)

PoC Collection This is the little script to collect the proof-of-concept which is refered from nomi-sec. The repository now is only develop for linux-

null 2 Aug 17, 2022
Downloads state flags from wikipedia for states/regions from all countries

world-state-flags Downloads state flags from wikipedia for states/regions from all countries This data is NOT curated Uses https://github.com/dr5hn/co

João Ribeiro Bezerra 1 Jan 28, 2022
Downloads separate (specified) file to a randomly generated folder in /TEMP then executes it.

PyTemp-1 A Python3 file downloader. What you do with this code / project / idea is non of my buisness or concern, and this was made for **educational*

NightTab 1 Aug 3, 2022
A bot to view Dilbert comics directly from Discord and get updates of the comics automatically.

A bot to view Dilbert comics directly from Discord and get updates of the comics automatically

Raghav Sharma 1 Feb 6, 2022
A bot to view Garfield comics directly from Discord and get updates of the comics automatically

Garfield-Bot A bot to view Garfield comics directly from Discord and get updates of the comics automatically. Instructions to use the bot: Invite the

Raghav Sharma 3 Feb 13, 2022