The Researcher COVID data
Automated data scraper for Thailand COVID-19 data
Looks like most of the Github Actions are all failing.
get-vaccine-delivery
: IndexError: list index out of range
https://github.com/porames/the-researcher-covid-data/runs/4284380038?check_suite_focus=true
bot-task-scheduler - get-moh-prompt
: selenium TimeoutException
https://github.com/porames/the-researcher-covid-data/runs/4282943528?check_suite_focus=true
Read หมอพร้อม dashboard header for update date/time and put it in the dataset.
{
"update_date": date,
"data": []
}
And check if dashboard has newer data before attempt to scrape.
Thanks to Microsoft, selenium can't render power bi dashboard for หมอพร้อม. For now, Circle CI works fine but making it run using GitHub actions would be better. @plumsirawit try vpn or something?
Hi. For the vaccine data by doses national-vaccination-timeseries
, the scraped data is slightly different from the dashboard. Already minus the 4th dose.
For example on the 4th October, the scraped data:
{
"date": "2021-10-04",
"daily_vaccinations": 667141,
"data_anomaly": null,
"first_dose": 33232868,
"second_dose": 21187548,
"third_dose": 1467466,
"total_doses": 55887882
}
Moh Promp Dashboard. Checked data at 9pm 4th October
1st Dose: 33,232,871
2nd Dose: 21,187,550
3rd Dose: 1,467,466
Total: 55,887,887
Also if possible, it would be nice to add 4th dose to the scraper as well.
Shopee Scraper A web scraper in python that extract sales, price, avaliable stock, location and more of a given seller in Brazil. The project was crea
Searches YouTube, queries recommended videos and watches them. All fully automated and anonymised through the Tor network. The project consists of two independently usable components, the YouTube automation written in Python and the dockerized Tor Browser.
Autoscraper-n-blogger An Automated udemy coupons scraper which scrapes coupons and autopost the result in blogspot post and notifies via Telegram bot
Github Scraper Github scraper app is used to scrape data for a specific user profile. Github scraper app gets a github profile name and check whether
Deals of the Day This is a web scraper, using the Python framework Scrapy, built to extract data such as price and product name from the Deals of the
Video Games Web Scraper Video Games Web Scraper is a project that crawls websites and APIs and extracts video game related data from their pages. This
A Python Covid-19 cases tracker that scrapes data off the web and presents the number of Cases, Recovered Cases, and Deaths that occurred because of the pandemic.
Scrapera is a completely Chromedriver free package that provides access to a variety of scraper scripts for most commonly used machine learning and data science domains.
AutoScraper: A Smart, Automatic, Fast and Lightweight Web Scraper for Python This project is made for automatic web scraping to make scraping easy. It
WhatSoup ?? A web scraper that exports your entire WhatsApp chat history. Table of Contents Overview Demo Prerequisites Instructions Frequen
clalit-appt-checker Python scraper to check for earlier appointments in Clalit Health Services Some background If you ever needed to schedule a doctor
Udemy Scraper A Web Scraper built with beautiful soup, that fetches udemy course information. Installation Virtual Environment Firstly, it is recommen
Disboard-Scraper Threaded Scraper to get discord servers from disboard.org written in python3. Setup. One thread / tag If you whant to look for multip
Proxy Scraper A simple proxy scraper that utilizes the requests module in python. Usage Depending on your python installation your commands may vary.
Dissec A simple python web scraper. It gets a website and its contents and parses them with the help of bs4. Installation To install the requirements,
Twitter's API is annoying to work with, and has lots of limitations — luckily their frontend (JavaScript) has it's own API, which I reverse–engineered. No API rate limits. No restrictions. Extremely fast.
Features Scrap from url Scrap from recommendation Search by query Todo [+] Search by genre Example # Get download url >>> from kusonime import Scrap >
simple http & https proxy scraper and checker
Features Scrap from url Todo [+] Search by genre [+] Search by query [+] Scrap from homepage Example # Hentai Scraper >>> from nekopoi import Hent >>>