Blockchain Address Ownership Database

The database is in data/addresses.db

This is a SQLite database of addresses from several blockchains. It's obtained by page scraping & API-querying etherscan's team scanners. For each address it has some subset of [name tag, labels, ownership entity]. I page scraped each labelcloud (i.e. etherscan.io/labelcloud) for all labels, and then got all the addresses for each labels with their name tags. Additionally, I downloaded all addresses created by each labeled contract deployer and factory contract (using the scanner's API)

Exceptions: I didn't download all the million of shitcoin pools from uniswap and pancakeswap, only pools with at least 10 transactions. Also, etherscan-like scanners only allow for first 10000 transactions to be accessed via API, so children addresses will be missing from especially prolific deployers and factories.

The database will not update automatically. I may occasionally update it. You can create your own copy with the code; it requires BeautifulSoup for scraping, and cookie and API key from each scanner for the blockchains you want. If you're doing ETH or BSC it will take several hours.

Currently the database has:

~160K ETH addresses
~77K BSC addresses
~9K Polygon addresses
~13K HECO addresses
~2K Fantom addresses
~0.5K HSC addresses

Comments

UI and dependencies

Interesting project. Added some nice-to-haves that I hope are helpful.

Dependencies

I used pipreqs to generate a requirements.txt file.

Simple/Quick data exploration

Added sqlite_web package. It's a small flask web-server CLI app that runs on 127.0.0.1 and lets you visually explore the sqlite tables and data. From the project root you can run python ./frontend/db_browse.py or you can use CLI command in terminal sqlite_web ./data/addresses.db. Will automatically open a new browser tab.

opened by aaronwp 0