This project is a simple web scraper that scraps pages of jobinja.ir concurrently and writes and update (if file gets run more than once) dataset to .csv and .xlsx format.
This project is written in using Python3.9 but Python3.8 will work fine too.
Linux users
python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
python main.py
Twitter's API is annoying to work with, and has lots of limitations — luckily their frontend (JavaScript) has it's own API, which I reverse–engineered. No API rate limits. No restrictions. Extremely fast.
Features Scrap from url Scrap from recommendation Search by query Todo [+] Search by genre Example # Get download url from kusonime import Scrap
simple http & https proxy scraper and checker
Features Scrap from url Todo [+] Search by genre [+] Search by query [+] Scrap from homepage Example # Hentai Scraper from nekopoi import Hent
Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
snscrape snscrape is a scraper for social networking services (SNS). It scrapes things like user profiles, hashtags, or searches and returns the disco
Searches YouTube, queries recommended videos and watches them. All fully automated and anonymised through the Tor network. The project consists of two independently usable components, the YouTube automation written in Python and the dockerized Tor Browser.
Dailyiptvlist.com scraper Info Made in python Linux only script Script requires to have wget installed Running script Clone repository with: git clone
Github Scraper Github scraper app is used to scrape data for a specific user profile. Github scraper app gets a github profile name and check whether
WebScraping Web scraping Pyton program that scrapes Job website for python devel
Scrapera is a completely Chromedriver free package that provides access to a variety of scraper scripts for most commonly used machine learning and data science domains.
AutoScraper: A Smart, Automatic, Fast and Lightweight Web Scraper for Python This project is made for automatic web scraping to make scraping easy. It
WhatSoup ?? A web scraper that exports your entire WhatsApp chat history. Table of Contents Overview Demo Prerequisites Instructions Frequen
clalit-appt-checker Python scraper to check for earlier appointments in Clalit Health Services Some background If you ever needed to schedule a doctor
The Researcher COVID data Automated data scraper for Thailand COVID-19 data Accessing the Data 1st Dose Provincial Vaccination Data 2nd Dose Provincia
Udemy Scraper A Web Scraper built with beautiful soup, that fetches udemy course information. Installation Virtual Environment Firstly, it is recommen
Disboard-Scraper Threaded Scraper to get discord servers from disboard.org written in python3. Setup. One thread / tag If you whant to look for multip
Proxy Scraper A simple proxy scraper that utilizes the requests module in python. Usage Depending on your python installation your commands may vary.
Dissec A simple python web scraper. It gets a website and its contents and parses them with the help of bs4. Installation To install the requirements,
45 Dec 30, 2022
2 Jan 28, 2022
11 Nov 15, 2021
543 Jan 3, 2023
2.4k Jan 1, 2023
44 Oct 18, 2022
1 Oct 16, 2021
6 Apr 5, 2022
2 Jul 22, 2022
299 Dec 15, 2022
4.8k Jan 4, 2023
87 Jan 6, 2023
16 Sep 17, 2022
31 Apr 17, 2022
15 May 17, 2022
11 Nov 1, 2022
3 Sep 8, 2021
11 May 6, 2022