Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Good news for windows users this release. As always, for any bug refer to issues

PSA: Keep in mind windows has a hard time with japanese characters, that's a problem with cmd and I'm not sure if I can do something to mitigate it. But I'm looking into it. Anyone with more information about this can also refer to issues

Changelog

Windows binaries are available again

You read it right, "are", pynps is now shipped in two flavors for windows:

Windows installer: This is the best way for noobs to get everything runing, pynps is installed at C:\Program Files (x86)\pyNPS, this installer ships with wget.exe and pkg2zip.exe bundled within, the installer will also add pynps into the PATHS (only if installed as administrator, aka "For all users in this computer", tho). For people that don't care about these technicalities, basically this means you only need to install pynps and it'll work out of the box: just open cmd and type "pynps".

For the installer, pynps uses this directory C:\Users\USERNAME\Documents\pyNPSbin to store everything: -there's no lib folder, since it's bundled with the installer -settings file is at pyNPSbin\settings.ini -database is located at pyNPSbin\database\pynps.db

The download folder is C:\Users\USERNAME\Downloads\pyNPS

Windows portable exe file: This is a one file executable shipped inside a zip, compared to the Windows installer, the portable release should have a startup time that's a little slower; You'll still need to look for a pkg2zip.exe and a wget.exe file and put it in the lib folder inside place_where_you_extracted_zip\pynps\pynps_config\lib. You'll also need to add the pynps.exe into your PATH if you want to run it easily from cmd, double clicking the file don't work.

For the portable release, everything is done inside place_where_you_extracted_zip\pynps

• wget.exe and pkg2zip.exe, as already explaned, have to be inside pynps_config\lib\ -settings file is at pynps_config\settings.ini -database is located at pynps_database\pynps.db

The download folder is pynps_downloads, also inside place_where_you_extracted_zip\pynps

Support for pip on windows #14

Windows users that are familiar with python can now install pynps using pip! On WIndows, pynps uses this directory C:\Users\USERNAME\Documents\pyNPS to store everything:

• wget.exe andpkg2zip.exe have to be inside pyNPS\lib\ -settings file is at pyNPS\settings.ini -database is located at pyNPS\database\pynps.db

The download folder is C:\Users\USERNAME\Downloads\pyNPS

Windows user not using the installer can get pkg2zip from lusi1 and a wget build from here

BUG fixes

• fixes #22 845ee5e914962d72b7a757482bf21900cb0b4410

binaries are packed with pyinstaller and python 3.7.8. The installer is compiled with Inno Setup

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Binaries won't be available until pyinstaller starts working on python 3.8, anyone interested can track it here

Changelog

Support for downloading PS3 avatars #18, implemented by @smvueno at #21

Users can now download avatars for PS3, as any other PS3 pkg these will also not be extracted, but .rap will be downloaded when available. Users should use the flags -A, --avatars or -da to download pkgs from this category:

# this will search for Ratchet and Clank avatars
pynps -Ac ps3 'Ratchet and Clank'

As always, everything related to this console is saved inside a PS3 directory located in your download's folder.

d7d21e80ce9e99ec938d95cab151b5e99782188c

BUG fixes

• fixes flags not being checked for PSM 845ee5e914962d72b7a757482bf21900cb0b4410
• fixes force exit when using an unsupported flag alongside a supported one 3ac6ed5732bafc04ab0991113243c2157e6a1624
• fixes user being able to use -zip alongside -cso or -eb 41f0bf07f98b5b020c461bb10c3f7e6bf5424db2
• fixes flags' description, adds PS3 to all supported flags and fixes description for download resume 5d9ac9ea6a8601c27276842a35b6d81f03a604d0
• allow users to call --version with -v 7e0792f9372c9132515755dc974840a01fe778c7

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Binaries won't be available until pyinstaller starts working on python 3.8, anyone interested can track it here

ATTENTION (Updating users ONLY)!

Users coming from any past version will need to update the configuration file to add links related to the PS3 system, the easiest way of doing this is by removing the old settings.ini (located at ~/.config/pyNPS/settings.ini) and running pyNPS again to recreate the file.

Some users may want to do it manually for some reason, all you'll need to do is go to your settings.ini (located at ~/.config/pyNPS/settings.ini) and add the following section anywhere (respecting other sections of course):

[PS3_Links]
games = https://nopaystation.com/tsv/PS3_GAMES.tsv
dlcs = https://nopaystation.com/tsv/PS3_DLCS.tsv
themes = https://nopaystation.com/tsv/PS3_THEMES.tsv
demos = https://nopaystation.com/tsv/PS3_DEMOS.tsv
avatars = https://nopaystation.com/tsv/PS3_AVATARS.tsv

Users fixing their settings manually should also consider moving their old links from http to https.

Changelog

PS3 Support #10

Users can now download PS3 pkgs:

# this will search for GTA V for the PS3
pynps -Gc ps3 'Grand Theft Auto V'

There's no pkg2zip extraction going on for PS3 (therefore -eb, -cso and -zip flags will be ignored). Packages are saved as .pkg (inside the packages subfolder) and .rap (inside the exdata subfolder) when available. Everything related to this console is saved inside a PS3 directory located in your download's folder. For now downloading avatar files isn't supported by pynps, but it'll be implemented eventually.

EBOOT.pbp identification #11

In version 1.4.3 I started efforts to find a way make identification easier for eboot games. At that release I started scanning the eboot file for the game's name and making a .txt file in the same folder as the eboot with the found name, it also only worked for PSX games... well, I was dumb, I have all the information needed for any game available at hand since this data is inside the database already, so scanning the file for a name is just not necessary and specially not performance friendly. So it changed it in this release:

In this version every bit of information is retrieved from the database, the .txt file inside the folder will be named using a pattern like this: Name (Region) [Tittle ID].txt. The file isn't empty anymore, instead I dump all the info for the pkg inside as json. This feature is also available for both PSP and PSX eboots.

Here's an example: Crossroad Crisis (US) [NPUJ01342].txt Here's how it looks indide the folder:

Why not rename the folder instead of making a text file? Well, PSP/Adreanline don't handle well name modification in the eboot's folder, instead of creating more problems just putting a text file there so the user can check it in the console/PC is more reasonable. I'm open to ideas on better ways to solve this, tho.

2b66757c3192d7d494458571b8af61609a127524

BUG fixes

• fixes a bug where PSP ISOs weren't being saved 46cfca1fd921c66b1c77d32698d05483926d86a3
• migrate all links to https de364ce3ea9e6488e3e9770c767201d80114073c

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Binaries won't be available until pyinstaller starts working on python 3.8, anyone interested can track it here

Changelog

Multisearch

You can now do multisearch by joining multiple keywords together with +. An example

# searching for Spyro, Crash Bandcoot and Harvest Moon games on psx
pynps -cG psx "spyro+crash bandcoot+harvest moon"

d5aab019afd529c8ab6dcc388ae9f5505e2b2d8b

Sorting search results

You're now able to sort the search output with a string by using the flag -s or --sort. Available options for sorting are: console or c, title_id or id, region or r, type or t, game_name or n, size or s. You can use multiple options with a comma, when doing so there's hierarchy and the more to the left the option is, the more priority it has in sorting items. When this flag is not used, pynps will default to "c,t,r,n" for sorting. Example:

# the example below will sort the search by "type" and "size", "type" will take priority over "size"
pynps --sort "t,s" -zip -r usa -c psx -c psv "crash"

d5aab019afd529c8ab6dcc388ae9f5505e2b2d8b

Extract PKG to a ZIP file #12

Option to extract the pkg into a zip file, instead of a folder, this is good for people looking to download a bunch of games for preservation sake. When downloading multiple games, each game will be their own zip file. To use this option just call the flag -zip or --compress_zip like so:

pynps -zip -c psx "Umi no Nushi Tsuri"

PSA: zip files are stored inside a "ZIP" folder in your downloads, instead of "Extracted".

9d7ce5e3aa4fd23d720664ef10996923fccfbcc6

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Binaries won't be available until pyinstaller starts working on python 3.8, anyone interested can track it here

Changelog

• when downloading a PSX game, pynps will now create a .txt file inside the eboot folder with the game's name, making them easy to identify. This is done by reading the name from the .pbp file and is a straight copy of BertrandHustle's implementation in psx_scraper 8cdb9718ca36ef1e81307b93d62ad77fae4d4420

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Changelog

• fixes #7 0098e2f4705aebd37969d165273de24783652581

binaries will be available once I get pyinstaller working again.

Be safe and wash your hands! Let's fight COVID19 together.

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Changelog

• add --print/-p argument, with this argument pynps will print (encoded in unicode, to avoid issues with cmd and terminal with strange characters) any search you make and exit, it's ideal for people looking to redirect a search into a text file ba15ea7e494c27148d6c81433b7af35934530130

#the following will search for all games in psvita and redirect the output to output.txt
pynps -Gpc psv _all > output.txt

# the following will search for all spyro games and dlcs in psp and redirect the output to spyro.txt
pynps -GDpc psp spyro > spyro.txt

# or you can just print the above without saving the output
pynps -GDpc psp spyro

A video on the new feature: binaries packed with pyinstaller

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Windows binary available

There's now a 64bits Windows binary available for download, you'll neet to get a 64bits wget.exe from here or any other place you wish, you'll also need to grab the latest pkg2zip_64bit.zip from lusid1's releases. Here's what you'll need to do:

Extract the windows .zip release to any folder you wish, open the extracted folder and drop wget.exe and pkg2zip.exe inside the pynps_config/lib/ subfolder! All you need now is run pynps.exe from CMD, you might also want add pynps.exe to your PATH so you can run it with "pynps" command, here's a good tutorial

Easily stop and resume downloads!

It's now possible to save a download session to be resumed latter using the -R/--resume argument, more info in this video (I'll also upload some videos for the README.md tutorials): The database file that keeps up with your downloads is inside /home/$USER/.config/pyNPS/database/downloads.db, in case something goes wrong you can delete it and always open an issue here on github!

A change of flow...

Before ths update pynps work would flow like this: Assuming you're downloading 1)sonic, 2)crash and 3)spyro: * Downloads 1 -> Checksum 1 -> Download 2 -> Checksum 2 -> Download 3 -> Checksum 3 -> Extract 1 -> Extract 2 -> Extract 3

From this and future updates, due to changes realted to resuming downloads (and keeping up with what was downloaded or not), it now flows like this: * Downloads 1 -> Checksum 1 -> Extract 1 -> Downloads 2 -> Checksum 2 -> Extract 2 -> Downloads 3 -> Checksum 3 -> Extract 3

Changelog

• fixes phantom folders being created inside /home/$USER/.config/pyNPS/database/ ac01106e30e945c3ed9ad5ba01c5481851390de8
• ignores cart-only games, since they can't be downloaded 99a4775ff0951794d4b710946bf7c064da683630
• some typing errors d27fabdde816eb6f828b11d034a0e7543ad88b67
• resume download implementation 5f2625697d275d40252211c414a5270970afbebb
• windows support 48a4c4e9d7c7dac88b6034cd171ade3ba415ec25 74f170b0b14d4e2552566f35a8ebb9892f077560
• closes #4

binaries packed with pyinstaller

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Changelog

• fixes bug with prompt toolkit not being apple to print some special characters, special thanks to the guys over their github repo 40d1593d78404b68244e2ee2d122760be1370bdb

binary packed with pyinstaller

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Changelog

• add support for download speed limit, the new argument is -l or --limit_rate 67549cce52aab6e61d1153365bc59a4c4e3a4775

  # uses the same syntax as wget
  # the following command will limit the download speed at 50kbps
  # you can use m for mbps, g ofr gbps and t for tbps
  >pynps -c psv -G -l 50k sonic
  

• pynps will now delete a successfully extracted .pkg, users can use the new argument -k or --keepkg if he/she is interested in keeping the .pkg file acddd29c053da7a98cd482202ec06bf82770d84a
• makes pkg2zip not obligatory to run the program, extraction and .pkg deletion will be skipped in this case 09313a88801aecf889cb873da0258c5ad9d941b5

binary packed with pyinstaller

Bugfix release

Pypi release is updated. Upgrade with pip using:

pip install pynps --upgrade

Changelog

• fixes bug were the lib folder would be created at /home/$USER/.config/pyNPSlib instead of /home/$USER/.config/pyNPS/lib b5607a093802585c4bb2a6dcdc65a9b7f1f1ab7e
  • Make sure to remove /home/$USER/.config/pyNPSlib in case you were affected.
• adds a workaround for a current bug in prompt toolkit were some symbols like "&" would break the HTML implementation for colors 6f6b9197d03cc42ce02e4939f6863ba4bd0dd0a9
• prevent app from runing without a database file c6681bec51b33c5b909eef8d66425b90556bc6e8
• gracefully exit with control+c when wget is downloading, explain to the user about paused download

binary packed with pyinstaller

Atention

Distro specific releases deprecated

I won't be doing distro specific releases anymore (aka no .rpm and .pacman packages anymore), but pynps will still be distributed as binary here and it's now available at pypi, therefore it can also be installed with pip:

pip install pynps

New database system

Starting with this release pynps will use SqliteDict for all its database operations.

Strides were made in improving database performance in this release, with some drawbacks:

TL;DR: search is now way faster, updating database is now slower.

• Cons
  • updating database 6x slower: updating the entire database will take ~172 seconds versus ~30 seconds in last release.
• Pros
  • reading from the database is 17x faster: reading the entire database will take ~0.3 seconds versus ~4.9 seconds in last release;
  • reading and printing the database is 8x faster: reading the entire database will take ~8 seconds versus ~60 seconds in last release;

The entire database now resides in a single file inside /home/$USER/.config/pyNPS/database/pynps.db

Optional manual intervention needed

The user should delete every folder inside /home/$USER/.config/pyNPS/database/, since the .tsv files there are deprecated.

Changelog

Note: the README.md got updated to document the new features.

• new arguments

--games   could be called with  -dg, now you can also use -G
--dlcs    could be called with  -dd, now you can also use -D
--themes  could be called with  -dt, now you can also use -T
--updates could be called with  -du, now you can also use -U
--demos   could be called with -dde, now you can also use -E

# Now the user can more easily do searches like this (more info on README.md):
# this searches for sonic games and demos in the psvita database
>pynps -GEc psv sonic

• add support for multiple region inputs e41058b7573f83dde10593d73925225052393769

# the following command was how the app worked before this update, this still applies for this new version
# this will search for sonic in the psvita american database
>pynps -c psv -r usa sonic 

# this is new, the --region/-r argument can be called multiple times
# this will search for sonic in the psvita american and japanese database
>pynps -c psv -r usa -r jap sonic  

• add support for selective database updating 558dd14104629ab035d0060c3fb8ec15892fd359 2919e10b8c85d550a13c38a66930f7fe14748bb8

# the following command was how the app worked before this update, this still applies for this new version
# this will update the entire database, for every system
>pynps -u

# this is kinda new, before you could update a single system at a time
# this will update the entire database, for psp and psv
>pynps -u -c psp -c psv

# this is new
# this will update only the game and dlc database for psvita
>pynps -u -c psv -G -T
Or:
>pynps -GTuc psv

• implements SqliteDict c80e39002d9aca973dc291511146462d5432dbe3 to 558dd14104629ab035d0060c3fb8ec15892fd359
• remove support for search after updating database for security reasons 47acbabd03388a1162e8456f0872ebd024005328

binary packed with pyinstaller

Nopaystation beta ended, this update fixes the migration, but their https certification is currently broken, therefore pyNPS is using http until the Nopaystation team fixes the issue.

For users coming from version 1.0.0

If you're getting the following error when trying to updated your database:

FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpo5vjiom_/PSV_GAMES.tsv'

Make sure to fix your links at /home/$USER/.config/pyNPS/settings.ini, they'll neet to look like this:

[PSV_Links]
games = http://nopaystation.com/tsv/PSV_GAMES.tsv
dlcs = http://nopaystation.com/tsv/PSV_DLCS.tsv
themes = http://nopaystation.com/tsv/PSV_THEMES.tsv
updates = http://nopaystation.com/tsv/PSV_UPDATES.tsv
demos = http://nopaystation.com/tsv/PSV_DEMOS.tsv

[PSP_Links]
games = http://nopaystation.com/tsv/PSP_GAMES.tsv
dlcs = http://nopaystation.com/tsv/PSP_DLCS.tsv
themes = http://nopaystation.com/tsv/PSP_THEMES.tsv
updates = http://nopaystation.com/tsv/PSP_UPDATES.tsv

[PSX_Links]
games = http://nopaystation.com/tsv/PSX_GAMES.tsv

[PSM_Links]
games = http://nopaystation.com/tsv/PSM_GAMES.tsv

Changelog

• adds dynamic print, this means output line will adapt and fill your terminal line nicely :) 2c9bd7a4856ab7e0f031a5272bb64322b8c98310
• adds support for international (int) region, this region is used for sony's apps 1cfc257e2cc13d1fb767d3856a5ed4e09177e0bd
• adds setup.py 590acef72033e6cba818e2795065a6918395a897
• reworket how wget and pkg2zip is detected in the system 5340cc7576aa03bd08110e859cd4c146778380a8
• migration from beta.nopaystation.com to nopaystation.com 2f7d1d7ce42910fbdd09dcb44b53cad3973bc5d1
• cleaned a bunch of code c2515076fb086abf5a7aa72f6d5f624076c19384

binary packed with pyinstaller

This is the first stable release, there's basically no changes from the last one, so there's no changelog. The main purpose of this release is to fix my tag/release numbers to a better format and changing the repository name to remove capitalization. This is being done in order to make the multiple builds I'm planing to release less messy to make :)

From now on the release pattern will be: A.B.C-D, where:

• A number will go up with a major update lands or B runs out;
• B number will go up with normal features updates, or when C runs out;
• C number will go up with bugfixes;
• D is the version of package, has no relation with the app version itself.

Changelog

• show the exact extracting location when possible 53d4186dafd579cceb931d9f00c84f3c5624021f
• fix zrif being printed for debug introduced on last release 7d15c24c5327988ad9d983ab0671a7b478998172
• print --help when no search is provided 1477df6afbd9ac19237b36c2bf9db9b6fd50e579

binary packed with pyinstaller binary checksum: 1e98f10801bd84c5908643b791d9d0f78e20199f8c841ba7c5e66b73ef9e210d

Changelog

• rewrite how the app handles the --console/-c, some examples below 01e88dff5588f49b3420ffcbecdee2aab931517e

# the following command was how the app worked before this update, this still applies for this new version
# this will search for sonic in the psvita database
>pynps -c psv sonic 

# this is new, the --console/-c argument can be called multiple times
# this will search for sonic in the psvita and psp database
>pynps -c psv -c psp sonic 

# this is also new, now the user can just omit the --console/-c argument
# this will search for sonic in all console's databases
>pynps sonic 

# the example above can also be archieved by calling every console with the --console/-c argument
# this will also search for sonic in all console's databases
>pynps -c psv -c psp -c psx -c psm sonic 

• add support for unpacking psp games as EBOOT.PBP 7ffa2cf293df6edaf1efdb63cf56ff9fd8308d8d f0851306b6f7ec5e7b32107c6de3509a4e91d98c
• fixes error were psvita games without zrif would not extract f0851306b6f7ec5e7b32107c6de3509a4e91d98c
• add more colors
• add new argument --version to output the current version being run

binary packed with pyinstaller binary checksum: d3d8ca7c93ed8298443e80a69c478bcee4924fa04a64eaf0a0738a3f407ad4d7

Bugfix release

• this release fixes a bug that was making cso compression not work, thank you @framki for pointing it out in https://github.com/evertonstz/pyNPS/pull/3

binary packed with pyinstaller binary checksum: ab4f7654393c8ce5e0ceae93ccf130d004be3d18797cfd39899c9a9d7dcf96f4

Attention

New users can ignore this warning!

The user coming from any past version will need to update the configuration file to add links related to the PSM system, the easiest way of doing this is by removing the old settings.ini (located at ~/.config/pyNPS/settings.ini) and runing pyNPS again to recreate settings.ini.

Some users may want to do it manually for some reason, all you'll need to do is go to your settings.ini (located at ~/.config/pyNPS/settings.ini) and add the following section anywhere (respecting other sections of course):

[PSM_Links]
games = https://beta.nopaystation.com/tsv/PSM_GAMES.tsv

Changelog

• add support for PSM games efa1335253e61c31c543ddc9c128719fb53fa289
• add support for packing PSP games as .cso files with multiple levels of compression available ( requested by #1 ) ec9f15ce2de2db074575283ca3151b826c5fb486
• fixes script ignoring user selection to not download selected content 0ff8301cf3acecc706a05b274c4edfdb073b9007
• use a less verbose method to call wget 80dbebd74693b0e2e2aee1abb29d1c4447f6288b
• gracefully exit with control+c when this option is presented to users (on inputs) 0ff8301cf3acecc706a05b274c4edfdb073b9007
• removes mandatory order for information in the settings.ini file 1f607b97f8b26f5e082f00813047e90c744e85cd
• some bugfixes, full changelog can be found in the commits

binary packed with pyinstaller binary checksum: 992a9a5b7ac2c175609eabc18c7b027411cf849f3117d2870eaa4c06d6a16b8c

Changelog

• started using python prompt toolkit for print and input
• added some color and cleaned some of the output
• removed output parsing for wget, since it was only working for English speaking users
• fixed bug were wget would leave a bunch of logfiles everywhere
• fixed exit error
• full changelog can be checked at commits

binary packed with pyinstaller binary checksum: 59de15055f6a155eae4ac5fadeda4af552e25bb3196aa38894b1b9bfa8e6cfb0

Initial release.

binary packed with pyinstaller binary checksum:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855