Astra is a tool to find URLs and secrets.

Stinger

Last update: Dec 27, 2022

Related tags

URL Manipulation Astra

Overview

Astra finds urls, endpoints, aws buckets, api keys, tokens, etc from a given url/s. It combines the paths and endpoints with the given domain and gives full URL. We can use it on js, html, etc files. Astra uses asynchronous method to fetch URLs using python's aiohttp and asyncio. Its a combination of linkfinder and secretfinder. Uses Regex's from linkfinder, secretfinder and nuclei templates. Although None of them worked exactly because python's regex r way different. So basically everyone of them is modified by me.

Installation

git clone https://github.com/Sachin-v3rma/Astra && cd Astra
pip3 install -r requirements.txt

Usage

Takes Input from stdin, so easy to use in automation.

Flags :

-ns --> No secrets. Only find urls and endpoints. Also increases the speed.
-t  --> Threads. Only increase if you have strong internet connection.

Example :

cat live_subdomains.txt | python3 astra.py
echo https://www.example.com | python3 astra.py -ns |tee astra_urls.txt
cat js_urls.txt | python3 astra.py -t 20 | anew urls_secrets.txt

Output :

If u wanna remove the counter comment out the line 174-177 or you can use head command to remove them. 
Use grep "\[IP\]" to grep IPs.
Use grep "\[$\]" to grep secrets.
Use grep "\[C\]" to grep aws buckets.
Use grep "^http" to grep URLs.

Also decrease the threads if your internet connection is weak (like i use mobile data :( ).

Creator

Made by Sachin Verma with <3
Twitter : sachin_vm

NO BANNER BECAUSE WHY ??

Comments

broken pipe

is this my issue or the tools issue?full error below

Traceback (most recent call last): File "/root/Astra/Astra.py", line 172, in asyncio.get_event_loop().run_until_complete(start(urls, threads)) File "/usr/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete return future.result() File "/root/Astra/Astra.py", line 142, in start await asyncio.gather(*tasks) File "/root/Astra/Astra.py", line 123, in parser html = await fetch(session=session, url=url) File "/root/Astra/Astra.py", line 86, in fetch html = await response.text() File "/usr/lib/python3/dist-packages/aiohttp/client_reqrep.py", line 1081, in text return self._body.decode(encoding, errors=errors) # type: ignore File "/usr/lib/python3.9/encodings/cp1254.py", line 15, in decode return codecs.charmap_decode(input,errors,decoding_table) UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 183079: character maps to

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/root/Astra/Astra.py", line 188, in print(f'\n{col.magenta}[-]{col.red} Error : {repr(err)}{col.reset}') BrokenPipeError: [Errno 32] Broken pipe

opened by ghost 2

TypeError: function() argument 'code' must be code, not str

Hi,

When I try to launch Astra, I get this error:

Traceback (most recent call last):
  File "/dev/fd/63", line 4, in <module>
  File "/usr/lib/python3/dist-packages/aiohttp/__init__.py", line 6, in <module>
    from .client import (
  File "/usr/lib/python3/dist-packages/aiohttp/client.py", line 35, in <module>
    from . import hdrs, http, payload
  File "/usr/lib/python3/dist-packages/aiohttp/http.py", line 7, in <module>
    from .http_parser import (
  File "/usr/lib/python3/dist-packages/aiohttp/http_parser.py", line 15, in <module>
    from .helpers import NO_EXTENSIONS, BaseTimerContext
  File "/usr/lib/python3/dist-packages/aiohttp/helpers.py", line 667, in <module>
    class CeilTimeout(async_timeout.timeout):
TypeError: function() argument 'code' must be code, not str

I have Python 3.9.9 installed on my Kali machine btw

opened by ghost 0

🌐 URL parsing and manipulation made easy.

furl is a small Python library that makes parsing and manipulating URLs easy. Python's standard urllib and urlparse modules provide a number of URL re

2.4k Jan 4, 2023

A simple, immutable URL class with a clean API for interrogation and manipulation.

purl - A simple Python URL class A simple, immutable URL class with a clean API for interrogation and manipulation. Supports Pythons 2.7, 3.3, 3.4, 3.

286 Jan 2, 2023

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

webargs Homepage: https://webargs.readthedocs.io/ webargs is a Python library for parsing and validating HTTP request objects, with built-in support f

1.3k Jan 1, 2023

This is a no-bullshit file hosting and URL shortening service that also runs 0x0.st. Use with uWSGI.

1.6k Dec 31, 2022

Customizable URL shortener written in Python3 for sniffing and spoofing

3 Nov 22, 2022

A simple URL shortener app using Python AWS Chalice, AWS Lambda and AWS Dynamodb.

url-shortener-chalice A simple URL shortener app using AWS Chalice. Please make sure you configure your AWS credentials using AWS CLI before starting

2 Dec 9, 2022

Ukiyo - A simple, minimalist and efficient discord vanity URL sniper

Ukiyo - a simple, minimalist and efficient discord vanity URL sniper. Ukiyo is easy to use, has a very visually pleasing interface, and has great spee

13 Apr 14, 2022

🔗 FusiShort is a URL shortener built with Python, Redis, Docker and Kubernetes

This is a playground application created with goal of applying full cycle software development using popular technologies like Python, Redis, Docker and Kubernetes.

7 Nov 10, 2022

Detect secret in source code, scan your repo for leaks. Find secrets with GitGuardian and prevent leaked credentials. GitGuardian is an automated secrets detection & remediation service.

GitGuardian Shield: protect your secrets with GitGuardian GitGuardian shield (ggshield) is a CLI application that runs in your local environment or in

1.2k Jan 6, 2023

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

img2dataset Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine. Also supports

1.4k Jan 1, 2023

Fast pattern fetcher, Takes a URLs list and outputs the URLs which contains the parameters according to the specified pattern.

Fast Pattern Fetcher (fpf) Coded with 3 by HS Devansh Raghav Fast Pattern Fetcher, Takes a URLs list and outputs the URLs which contains the paramete

5 Feb 20, 2022

Snscrape-jsonl-urls-extractor - Extracts urls from jsonl produced by snscrape

snscrape-jsonl-urls-extractor extracts urls from jsonl produced by snscrape Usag

1 Feb 26, 2022

Aggrokatz is an aggressor plugin extension for Cobalt Strike which enables pypykatz to interface with the beacons remotely and allows it to parse LSASS dump files and registry hive files to extract credentials and other secrets stored without downloading the file and without uploading any suspicious code to the beacon.

aggrokatz What is this aggrokatz is an Aggressor plugin extension for CobaltStrike which enables pypykatz to interface with the beacons remotely. The

148 Dec 9, 2022

We want to check several batch of web URLs (1~100 K) and find the phishing website/URL among them.

We want to check several batch of web URLs (1~100 K) and find the phishing website/URL among them. This module is designed to do the URL/web attestation by using the API from NUS-Phishperida-Project.

3 Dec 28, 2022

🤫 Easily manage configs and secrets in your Python projects (with CLI support)

Installation pip install confidential How does it work? Confidential manages secrets for your project, using AWS Secrets Manager. First, store a secr

63 Oct 30, 2022

Keybase-cli - Keybase docker container that exposes the keybase CLI and some common commands such as getting files or loading github action secrets

keybase-cli Keybase docker container that exposes the keybase CLI and some commo

4 Aug 4, 2022

domhttpx is a google search engine dorker with HTTP toolkit built with python, can make it easier for you to find many URLs/IPs at once with fast time.

domhttpx is a google search engine dorker with HTTP toolkit built with python, can make it easier for you to find many URLs/IPs at once with fast time

59 Dec 4, 2022

APKLeaks - Scanning APK file for URIs, endpoints & secrets.

3.5k Jan 9, 2023

Manage AWS Secrets the easy way

AWStanding Easily load variables from AWS Parameter store into environment variables. Why to AWStanding? Because it handles AWS pagination so the amou

13 Dec 30, 2022

Astra is a tool to find URLs and secrets.

Related tags

Overview

Installation

Usage

Creator

You might also like...

🌐 URL parsing and manipulation made easy.

A simple, immutable URL class with a clean API for interrogation and manipulation.

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

This is a no-bullshit file hosting and URL shortening service that also runs 0x0.st. Use with uWSGI.

Customizable URL shortener written in Python3 for sniffing and spoofing

A simple URL shortener app using Python AWS Chalice, AWS Lambda and AWS Dynamodb.

Ukiyo - A simple, minimalist and efficient discord vanity URL sniper

🔗 FusiShort is a URL shortener built with Python, Redis, Docker and Kubernetes

Detect secret in source code, scan your repo for leaks. Find secrets with GitGuardian and prevent leaked credentials. GitGuardian is an automated secrets detection & remediation service.

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

Fast pattern fetcher, Takes a URLs list and outputs the URLs which contains the parameters according to the specified pattern.

Snscrape-jsonl-urls-extractor - Extracts urls from jsonl produced by snscrape

We want to check several batch of web URLs (1~100 K) and find the phishing website/URL among them.

🤫 Easily manage configs and secrets in your Python projects (with CLI support)

Keybase-cli - Keybase docker container that exposes the keybase CLI and some common commands such as getting files or loading github action secrets

domhttpx is a google search engine dorker with HTTP toolkit built with python, can make it easier for you to find many URLs/IPs at once with fast time.

APKLeaks - Scanning APK file for URIs, endpoints & secrets.

Manage AWS Secrets the easy way

Comments

broken pipe

TypeError: function() argument 'code' must be code, not str

Owner

Stinger

UDdup - URLs Deduplication Tool

:electric_plug: Generating short urls with python has never been easier

🔗 Generate Phishing URLs 🔗

URL Shortener in Flask - Web service using Flask framework for Shortener URLs

A teeny Tiny module to check URLs against discord's list of phishing domains

Temporary-shortner - A webapp that shortner URLs but for limited time

find all the URL of a site with a specific Regex

Have you ever wondered: Where does this link go? The REDLI Tool follows the path of the URL.

A tool programmed to shorten links/mask links

A tool to manage the base URL of the Python package index.