limnopapers

Code to monitor limnology RSS feeds and tweet new articles.

Scope

The keywords and journal choices herein aim to focus on limnology (the study of inland waters). They are also meant to exclude related topics such as fisheries ecology, water resources engineering, estuarine/marine ecology, ecological genetics, and the study of specific "inland seas" like the North American Great Lakes. Feel free to weigh-in in the repository issues on scope recommendations!

Usage

Query papers that came out prior to today without tweeting:

python limnopapers/limnopapers.py

Query papers that came out prior to today and open in browser:

python limnopapers/limnopapers.py --browser

Manually approve tweeting of papers that came out prior to today:

python limnopapers/limnopapers.py --interactive

Unsupervised tweeting of papers that came out prior to today:

python limnopapers/limnopapers.py --tweet

Setup

Enable tweeting (optional)

Create a file named config.py that stores your twitter API keys

Enable unsupervised tweeting (optional)

Create a cron job. On Linux this can be done with the following commands:

crontab -e 
0 15 * * * python /path/to/limnopapers.py

Python dependencies

See requirements.txt

Install these to the activated environment with:

pip install -r requirements.txt

Contributing

Please help by adding missing journals to limnopapers/journals.csv or filing an issue
Filtering keywords are located in limnopapers/keywords.csv.

Prior art

https://github.com/ropenscilabs/data-packages

Automation that uses Github Actions, Google Drive API, YouTube Data API and youtube-dl together to feed BackJam app with new music

1 Nov 21, 2021

A Python implementation of a Youtube Subscription manager & feed viewer, also does thumbnails

BUILDING Building requires python3.10, and the build package, which can be installed via pip: python3.10 -m pip install build To install, run python3.

2 Feb 28, 2022

Backtest 1000s of minute-by-minute trading algorithms for training AI with automated pricing data from: IEX, Tradier and FinViz. Datasets and trading performance automatically published to S3 for building AI training datasets for teaching DNNs how to trade. Runs on Kubernetes and docker-compose. 150 million trading history rows generated from +5000 algorithms. Heads up: Yahoo's Finance API was disabled on 2019-01-03 https://developer.yahoo.com/yql/

Stock Analysis Engine Build and tune investment algorithms for use with artificial intelligence (deep neural networks) with a distributed stack for ru

828 Dec 28, 2022

The Sue Gray Alert System was a 5 minute project that just beeps every time a new article is updated or published on Gov.UK's news pages.

1 Jan 31, 2022

Comments

Better limno filtering
Could try a strategy where I:

[ ] build a word distribution bank from a library of limno papers

[ ] score the correspondence of a candidate abstract against the word bank

[ ] limit filtered papers to some cutoff
opened by jsta 2
Journal of Limnology missing from list

Dear authors The Journal of Limnology, a nearly 80 years old journal centred on limnology is missing from the feed. https://www.jlimnol.it/index.php/jlimnol/issue/view/73 Please consider adding it. Kind regards Journal of Limnology Twitter: @j_limnology
journal request

opened by EsterME 1
Truncate paper titles longer than twitter character limit

For example:

Linking landscape heterogeneity with lake dissolved organic matter properties assessed through absorbance and fluorescence spectroscopy: Spatial and seasonal patterns in temperate lakes of Southern Andes (Patagonia, Argentina). Science of the Total Environment. https://www.sciencedirect.com/science/article/pii/S0048969719324490?dgcid=rss_sd_all

breaks tweet posting.

opened by jsta 1
Remove quotes from paper titles

"First, do no harm - Missing data treatment to support lake ecological condition assessment",Environmental Modelling & Software,https://www.sciencedirect.com/science/article/pii/S1364815222002584?dgcid=rss_sd_all,,

opened by jsta 0

Releases(1.0.2)

1.0.2(Dec 3, 2021)

After breaking logging trying to deal with question mark titles
Source code(tar.gz)
Source code(zip)
1.0.1(Dec 3, 2021)

Before breaking logging because I tried to handle question mark titles
Source code(tar.gz)
Source code(zip)
1.0.0(Jul 14, 2021)

Source code(tar.gz)
Source code(zip)
0.0.1(Aug 7, 2020)

Source code(tar.gz)
Source code(zip)