🐳
RAUDI: Regularly and Automatically Updated Docker Images
RAUDI (Regularly and Automatically Updated Docker Images) automatically generates and keep updated a series of Docker Images through GitHub Actions for tools that are not provided by the developers.
Table of Contents
- What is RAUDI
- Fork
- Setup
- Local Usage
- Available Tools
- Tool Structure
- Helpers
- Examples
- Contributions
- Credits
- License
What is RAUDI
RAUDI is what will save you from creating and managing a lot of Docker Images manually. Every time a software is updated you need to update the Docker Image if you want to use the latest features, the dependencies are not working anymore.
This is messy and time-consuming.
Don't worry anymore, we got you covered.
You may either fork this repo and use the GitHub Workflow yourself or use it locally (and manage its execution the way you want).
Fork
If you want to fork this repo you also have to set up some secrets to be able to push your images on your personal Docker Hub account. Two GitHub secrets must be set:
- DOCKER_USER: Your Docker Hub Username;
- DOCKER_API_TOKEN: Your Docker Hub Password or API Token.
After setting those secrets you have to edit the organization variable set in the tools/main.py file since it is configured to push on the Docker Hub for SecSI.
That's all guys: go to Action, enable it for your forked repo, wait until midnight, and the Workflow will do the heavy work!
Setup
This repo can also be executed locally. The requirements to be met are the following:
- Python 3.x
- Docker
The setup phase is pretty straightforward, you just need the following commands:
git clone https://github.com/cybersecsi/RAUDI
cd RAUDI
pip install -r requirements.txt
You're ready to go!
Local Usage
RAUDI can build and push all the tools that are put into the tools directory. There are different options that can be used when running it.
Execution Modes
Normal Execution
In this mode RAUDI tries to build all the tools if needed. The command to run it is simply:
python3 ./raudi.py --all
Single Build
In this mode RAUDI tries to build only the specified tool. The command in this case is:
python3 ./raudi.py --single
tool_name MUST be the name of the directory inside the tools folder.
Show tools
If you want to know the available tools you can run this command:
python3 ./raudi.py --list
Bootstrap tool
If you want to quickly add a new tool folder starting from one of the available templates you can run this command:
python3 ./raudi.py --bootstrap
Options
| Option | Description | Default Value |
|---|---|---|
| --push | Whether automatically push to Docker Hub | False |
| --remote | Whether check against Docker Hub instead of local Docker before build | False |
| --force | Whether build or not if an image with the same tagname has been found | False |
Available Tools
This is the current list of tools that have been added. Those are all tools that do not have an official Docker Image provided by the developer:
Tool Structure
Every tool in the tools directory contains at least two file:
- config.py
- Dockerfile.
- README.md (optional README for Docker Hub)
If you want to add a new tool you just have to create a folder for that specific tool inside the tools directory. In this folder you have to insert the Dockerfile with defined build args to customize and automate the build. Once you created the Dockerfile you have to create a config.py in the same directory with a function called get_config(organization, common_args). Be careful: the function MUST be called this way and MUST have those two parameters (even if you do not use them). The returning value is the config for that specific tool and has the following structure:
config = {
'name': organization+'/
',
'version': '', # Should be an helper function
'buildargs': {
},
'tests': []
}
The four keys are:
- name: the name of the Docker Image (e.g. secsi/
); - version: the version number of the Docker Image. For this you may use a helper function that is able to retrieve the latest available version number (look at tools/ffuf for an example);
- buildargs: a dict to specify the parts of the Docker Images that are subject to updates (again: look at tools/ffuf for an example);
- tests: an array of tests (usually just a simple one like '--help').
After doing so you are good to go! Just be careful that the name of the tool MUST BE THE SAME as the directory in which you placed its Dockerfile.
There is a NAMING CONVENTION for the versions: use only DOTS and DIGITS; so please remove any trailing 'v' from the version in the specific config.py (for a working example check tools/dirsearch/config.py).
Helpers
To get the latest versions and information about tools and base images a set of helpers has been implemented. If you want to add a new tool you should use these helpers to have a Docker Image that is automatically updated by RAUDI.
get_latest_pip_version
This helper is used to retrieve the latest version of a pip package. All it takes is the name of the package and returns the version number. Example:
VERSION = helper.get_latest_pip_version(package_name)
get_latest_npm_registry_version
This helper is used to retrieve the latest version of a npm package. All it takes is the name of the package and returns the version number. Example:
VERSION = helper.get_latest_npm_registry_version(package_name)
get_latest_github_release
This helper is used to retrieve information about a GitHub repo that uses Releases and has multiple kind of assets (e.g. executables for different OSes). This helper takes the repo (in the format user/repo) and a target string to be able to identify the correct asset to download. It returns a dict with two keys (url and version). Example:
VERSION = helper.get_latest_github_release("user/repo", "linux_amd64")
get_latest_github_release_no_browser_download
This helper is used to retrieve information about a GitHub repo that uses Releases and has only the source code (which means there is a zipball and a tarball). This helper takes the repo (in the format user/repo) and returns a dict with two keys (url and version). Example:
VERSION = helper.get_latest_github_release_no_browser_download("user/repo")
get_latest_github_tag_no_browser_download
This helper is used to retrieve information about a GitHub repo that uses Tags and has only the source code (which means there is a zipball and a tarball). This helper takes the repo (in the format user/repo) and returns a dict with two keys (url and version). Example:
VERSION = helper.get_latest_github_tag_no_browser_download("user/repo")
get_latest_github_commit
This helper is used to retrieve information about a GitHub repo that doesn't use Tags or Releases. In this case, the goal is to retrieve the latest commit. This helper takes the repo (in the format user/repo) and returns a string representing the date of the last commit in the format YYYYYMMDD.
VERSION = helper.get_latest_github_commit("user/repo")
Examples
This section provides examples for the currently added Network Security Tools. As you can see the images do provide only the tool, so if you need to use a wordlist you need to mount it.
Generic Example
docker run -it --rm secsi/
Specific example
docker run -it --rm -v
:
secsi/dirb
/
Contributions
Everyone is invited to contribute! If you are a user of the tool and have a suggestion for a new feature or a bug to report, please do so through the issue tracker.
Credits
RAUDI is proudly developed @SecSI by:
License
RAUDI is an open-source and free software released under the GNU GPL v3.
![[Feature request] add netifyd](https://avatars.githubusercontent.com/u/4574593?v=4)
![[BUG] Unable to push images from GitHub Workflow](https://avatars.githubusercontent.com/u/20096272?v=4)
1 Nov 13, 2022
194 Sep 1, 2022
28.2k Jan 8, 2023
10 Oct 22, 2022
1 Feb 19, 2022
145 Nov 22, 2022
68 Nov 9, 2022
4 Dec 9, 2021
35.1k Jan 2, 2023
6 Aug 28, 2022
3 Nov 4, 2021
68 Dec 22, 2022
1 Dec 18, 2021
1 Nov 11, 2021
55 Aug 27, 2022
0 Dec 14, 2021
1 Jan 13, 2022
11 Dec 30, 2022