a CLI that provides a generic automation layer for assessing the security of ML models

Overview

Counterfit

About | Getting Started | Learn More | Acknowledgments | Contributing | Trademarks | Contact Us

---------------------------------------------------
Microsoft
                          __            _____ __
  _________  __  ______  / /____  _____/ __(_) /_
 / ___/ __ \/ / / / __ \/ __/ _ \/ ___/ /_/ / __/
/ /__/ /_/ / /_/ / / / / /_/  __/ /  / __/ / /
\___/\____/\__,_/_/ /_/\__/\___/_/  /_/ /_/\__/

                                        #ATML

---------------------------------------------------

About

Counterfit is a command-line tool and generic automation layer for assessing the security of machine learning systems.

Getting Started

Choose one of these methods to get started quickly:

For more information including alternative installation instructions, please visit our wiki.

Option 1: Deploy via Azure Shell

To run Counterfit from your browser

  1. Click the button below to initiate small resource deployment to your Azure account.

Deploy to Azure

  1. In the configuration blade, specify your subscription and resource group.
  2. In your Azure Shell, type the following, replacing RESOURCE_GROUP with the name of the resource group selected in the previous step.
az container exec --resource-group RESOURCE_GROUP --name counterfit --exec-command '/bin/bash'
  1. Within the container, launch Counterfit.
python counterfit.py

Option 2: Setup an Anaconda Python environment and install locally

  1. Install Anaconda Python and git.
  2. Clone this repository.
git clone https://github.com/Azure/counterfit.git
  1. Open an Anaconda shell and create a virtual environment and dependencies.
cd counterfit
conda create --yes -n counterfit python=3.7
conda activate counterfit
pip install -r requirements.txt
  1. Launch Counterfit.
python counterfit.py

Learn More

Visit our wiki for more detailed instructions on

Acknowledgments

Counterfit leverages excellent open source projects, including, Adversarial Robustness Toolbox and TextAttack.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

Contact Us

For comments or questions about how to leverage Counterfit, please contact [email protected].

Comments
  • Warning while loading framework and some other questions about output

    Warning while loading framework and some other questions about output

    Hi there,

    I downloaded the latest version of Counterfit last week and installed all the modules required but still have some problems. When I executed the command 'load art' I got a warning:

    load art

    The type of the provided estimator is not yet support for automated setting of logits difference loss. Therefore, this attack is defaulting to attacking the loss provided by the model in the provided estimator. [+] art successfully loaded with defaults (no config file provided)

    which did not exist before. When I executed the 'run' command I only got the adversarial input:

    run

    [-] Running attack HopSkipJump with id 12a70390 on creditfraud)

    [-] Preparing attack... [-] Running attack... ┌─────────┬──────────────┬──────────────────────────┐ │ Success │ Elapsed time │ Total Queries │ ├─────────┼──────────────┼──────────────────────────┤ │ 1/1 │ 4.3 │ 24550 (5740.6 query/sec) │ └─────────┴──────────────┴──────────────────────────┘ ┌┬┬┬┬────────────────────────────────────────────────────────────────────────┬┐ │││││ Adversarial Input ││ ├┼┼┼┼────────────────────────────────────────────────────────────────────────┼┤ │││││ [4462.00 -2.30 1.76 -0.36 2.33 -0.82 -0.07 0.56 -0.40 -0.24 -1.53 2.03 ││ │││││ -6.56 0.17 -1.47 -0.70 -2.28 -4.78 -2.62 -1.34 -0.43 -0.30 -0.93 0.17 ││ │││││ -0.09 -0.15 -0.54 0.04 -0.15 239.93] ││ └┴┴┴┴────────────────────────────────────────────────────────────────────────┴┘ [+] Attack completed 12a70390 (HopSkipJump)

    there are some differences in the scan summary as well (no 'queries'):

    Additionally, could you please explain some meaning of values in the scan summary and the running output? Could you please tell me what does it mean by 'successes'? When can we say an attack is a 'success' or 'failure'? I guess that 'best score' means the success percentage of samples in an attack, is it correct?

    In the running output, I guess the sample index means the number of samples in the attack right? What is the meaning of label and attack label? What is the meaning of % Eucl. dist. and Elapsed Time [sec]? I think 'queries' means the number of the attack on target, is it correct? I saw a list of decimal numbers in the adversarial input value, are they only random numbers or they have some similarities? Where are they from? Do they have some relations with my attack type?

    Thank you very much for your help and patience.

    opened by jiansuozhe 17
  • Error opening terminal.py

    Error opening terminal.py

    Describe the bug While in Counterfit conda env, I attempted to invoke 'python examples/terminal/terminal.py' but get error that Torch has no module 'nn'. I also get this error when running the code in Python (where I import counterfit and run the sample code). See Additional context below.

    POSSIBLE FIX: I see the below statement in another app I am using. The error in this issue may be due to not creating the import alias (?):

    import torch.nn as nn

    To Reproduce Steps to reproduce the behavior:

    1. Go to https://github.com/Azure/counterfit/blob/main/examples/DEMO2-creditfraud.md
    2. Run 'python examples/terminal/terminal.py'
    3. The stack trace listed below occurs.
    4. Or, run the sample code where imports are performed in PY file and attacks are called in PY file (see Additional context).

    Expected behavior The terminal should allow use of the creditfraud shell as below counterfit> set_target creditfraud creditfraud>

    Stack trace (counterfit) paul@paul-ThinkPad-T480s:~/Desktop/Counterfit-AML/counterfit$ python examples/terminal/terminal.py Traceback (most recent call last): File "examples/terminal/terminal.py", line 9, in from examples.terminal.core.terminal import Terminal File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/examples/terminal/core/terminal.py", line 6, in from counterfit import CFPrint File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/counterfit/init.py", line 9, in from . import core, data, frameworks, reporting, targets File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/counterfit/frameworks/init.py", line 5, in from .art import art File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/counterfit/frameworks/art/art.py", line 17, in from art.utils import compute_success_array, random_targets File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/init.py", line 7, in from art import attacks File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/attacks/init.py", line 8, in from art.attacks import evasion File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/attacks/evasion/init.py", line 4, in from art.attacks.evasion.adversarial_patch.adversarial_patch import AdversarialPatch File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/attacks/evasion/adversarial_patch/adversarial_patch.py", line 31, in from art.attacks.evasion.adversarial_patch.adversarial_patch_numpy import AdversarialPatchNumpy File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/attacks/evasion/adversarial_patch/adversarial_patch_numpy.py", line 37, in from art.estimators.estimator import BaseEstimator, NeuralNetworkMixin File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/estimators/init.py", line 17, in from art.estimators import certification File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/estimators/certification/init.py", line 9, in from art.estimators.certification import deep_z File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/estimators/certification/deep_z/init.py", line 4, in from art.estimators.certification.deep_z.deep_z import ZonoDenseLayer File "/home/paul/anaconda3/envs/counterfit/lib/python3.8/site-packages/art/estimators/certification/deep_z/deep_z.py", line 29, in class ZonoDenseLayer(torch.nn.Module): AttributeError: module 'torch' has no attribute 'nn'

    Screenshots N/A

    Desktop (please complete the following information):

    • OS: Linux Ubuntu
    • Version: 22.04.1 LTS

    Additional context I followed install instructions from current site (today). I was using the older version where counterfit.py was used (if that helps) I installed into a completely new dir, conda env, etc.

    I also get this error when running the below code (from https://github.com/Azure/counterfit):

    import counterfit import counterfit.targets as targets

    target = targets.CreditFraud() target.load() attack_name = 'hop_skip_jump' new_attack = counterfit.Counterfit.build_attack(target, attack_name) results = counterfit.Counterfit.run_attack(new_attack)

    Type: Bug 
    opened by pstarconsult 8
  • Error with Anaconda Python environment install

    Error with Anaconda Python environment install

    Building wheels for collected packages: python-Levenshtein, torchfile, bs4, gym, networkx, clang, future, iopath, pyperclip, termcolor, wrapt, gdown, mpld3, word2number, docopt, sqlitedict, langdetect, wikipedia-api, overrides Building wheel for python-Levenshtein (setup.py) ... error error: subprocess-exited-with-error

    × python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [31 lines of output] running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-cpython-38 creating build/lib.linux-x86_64-cpython-38/Levenshtein copying Levenshtein/StringMatcher.py -> build/lib.linux-x86_64-cpython-38/Levenshtein copying Levenshtein/init.py -> build/lib.linux-x86_64-cpython-38/Levenshtein running egg_info writing python_Levenshtein.egg-info/PKG-INFO writing dependency_links to python_Levenshtein.egg-info/dependency_links.txt deleting python_Levenshtein.egg-info/entry_points.txt writing namespace_packages to python_Levenshtein.egg-info/namespace_packages.txt writing requirements to python_Levenshtein.egg-info/requires.txt writing top-level names to python_Levenshtein.egg-info/top_level.txt reading manifest file 'python_Levenshtein.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no previously-included files matching '*pyc' found anywhere in distribution warning: no previously-included files matching '*so' found anywhere in distribution warning: no previously-included files matching '.project' found anywhere in distribution warning: no previously-included files matching '.pydevproject' found anywhere in distribution adding license file 'COPYING' writing manifest file 'python_Levenshtein.egg-info/SOURCES.txt' copying Levenshtein/_levenshtein.c -> build/lib.linux-x86_64-cpython-38/Levenshtein copying Levenshtein/_levenshtein.h -> build/lib.linux-x86_64-cpython-38/Levenshtein running build_ext building 'Levenshtein._levenshtein' extension creating build/temp.linux-x86_64-cpython-38 creating build/temp.linux-x86_64-cpython-38/Levenshtein gcc -pthread -B /home/mike/anaconda3/envs/counterfit/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/mike/anaconda3/envs/counterfit/include/python3.8 -c Levenshtein/_levenshtein.c -o build/temp.linux-x86_64-cpython-38/Levenshtein/_levenshtein.o error: command 'gcc' failed: No such file or directory [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for python-Levenshtein Running setup.py clean for python-Levenshtein Building wheel for torchfile (setup.py) ... done Created wheel for torchfile: filename=torchfile-0.1.0-py3-none-any.whl size=5693 sha256=9ffaf688f6b324ff14fd5d40238bae410d91407f0b3f5135f0fe0aa76a4e3f75 Stored in directory: /home/mike/.cache/pip/wheels/b9/99/d1/9f3f4411a958a22ccf782e33c7238a07f04a9597f2f3b38792 Building wheel for bs4 (setup.py) ... done Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1257 sha256=cd3f60c49624cadc73dfc3f026ddfd440a4f79a1e05f3d6c6c7945ad31a21540 Stored in directory: /home/mike/.cache/pip/wheels/75/78/21/68b124549c9bdc94f822c02fb9aa3578a669843f9767776bca Building wheel for gym (setup.py) ... done Created wheel for gym: filename=gym-0.19.0-py3-none-any.whl size=1663091 sha256=027f153e5fdc6342102d2b0bb5c9d103d27a543c91a640f546a344b3b8a52e88 Stored in directory: /home/mike/.cache/pip/wheels/11/36/28/628f4dd3779e4037a6fca1aaed76827ffa4315c3ab6bfadcf6 Building wheel for networkx (setup.py) ... done Created wheel for networkx: filename=networkx-2.2-py2.py3-none-any.whl size=1526919 sha256=cd2e280d8fd8582c43bc79c94485f58c4feb27b4caa2ab970623c5a16ebf4074 Stored in directory: /home/mike/.cache/pip/wheels/c3/d7/dd/7e2e485ecd56541b03075c9e3692ec12f6b43e90d09f9a6a9a Building wheel for clang (setup.py) ... done Created wheel for clang: filename=clang-5.0-py3-none-any.whl size=30681 sha256=0bc080e6b00b857ac4babf8c1dcb6a5021f7295ab6d5c9cc7201c2b3b50d7876 Stored in directory: /home/mike/.cache/pip/wheels/f1/60/77/22b9b5887bd47801796a856f47650d9789c74dc3161a26d608 Building wheel for future (setup.py) ... done Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491058 sha256=578710c9de7bdef01072479ce01ef0c22685cf370074e6572b801d96e661c511 Stored in directory: /home/mike/.cache/pip/wheels/8e/70/28/3d6ccd6e315f65f245da085482a2e1c7d14b90b30f239e2cf4 Building wheel for iopath (setup.py) ... done Created wheel for iopath: filename=iopath-0.1.10-py3-none-any.whl size=31532 sha256=61864d9531c7806b20d5d8985882381f0d69738c6ff79335e7102c952a4abf21 Stored in directory: /home/mike/.cache/pip/wheels/89/3e/24/0f349c0b2eeb6965903035f3b00dbb5c9bea437b4a2f18d82c Building wheel for pyperclip (setup.py) ... done Created wheel for pyperclip: filename=pyperclip-1.8.2-py3-none-any.whl size=11123 sha256=75079a19dea97a998282a18b3e98f63cc32026c1b2bcaa35858de6442e409f95 Stored in directory: /home/mike/.cache/pip/wheels/7f/1a/65/84ff8c386bec21fca6d220ea1f5498a0367883a78dd5ba6122 Building wheel for termcolor (setup.py) ... done Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4832 sha256=afabaf04dd54fc73d2bbf7f267f9c090fe51636603bfa401270b3c49db4ec544 Stored in directory: /home/mike/.cache/pip/wheels/a0/16/9c/5473df82468f958445479c59e784896fa24f4a5fc024b0f501 Building wheel for wrapt (setup.py) ... done Created wheel for wrapt: filename=wrapt-1.12.1-py3-none-any.whl size=19553 sha256=7c03d30f68b6abd56dfd6b224a02cc85e2a0eae57b3aae856eff32c4df0a4996 Stored in directory: /home/mike/.cache/pip/wheels/5f/fd/9e/b6cf5890494cb8ef0b5eaff72e5d55a70fb56316007d6dfe73 Building wheel for gdown (pyproject.toml) ... done Created wheel for gdown: filename=gdown-3.12.2-py3-none-any.whl size=9674 sha256=a8f92d2e219dd25bc85f917f5e5cdbf5bfd3ba8753f8f7930868f31b119bcfae Stored in directory: /home/mike/.cache/pip/wheels/e2/62/1e/926d1ebe7b1e733c78d627fd288d01b83feaf67efc06e0e4c3 Building wheel for mpld3 (setup.py) ... done Created wheel for mpld3: filename=mpld3-0.3-py3-none-any.whl size=116686 sha256=b4ecb5d9673cc060d659690b720838db99cbabb4e0339a1707d9301f5aa2422e Stored in directory: /home/mike/.cache/pip/wheels/3d/9f/9d/d806a20bd97bc7076d724fa3e69fa5be61836ba16b2ffa6126 Building wheel for word2number (setup.py) ... done Created wheel for word2number: filename=word2number-1.1-py3-none-any.whl size=5567 sha256=c76c90012dd58a1fcf7826ad4be92b1cabfaaa88c68e56e23bc1f5d8a3b174c5 Stored in directory: /home/mike/.cache/pip/wheels/cb/f3/5a/d88198fdeb46781ddd7e7f2653061af83e7adb2a076d8886d6 Building wheel for docopt (setup.py) ... done Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13706 sha256=ed4bd721de91451b090dd9e31ced07696d4c7cfca6445d0b3f602396d5d2e5ee Stored in directory: /home/mike/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c Building wheel for sqlitedict (setup.py) ... done Created wheel for sqlitedict: filename=sqlitedict-2.0.0-py3-none-any.whl size=15734 sha256=68064c06004c819ed85ffab311942f528c86a25c7b5c5cb2d5c49d1fd226ee1e Stored in directory: /home/mike/.cache/pip/wheels/ee/0b/8c/3cdf3e7eef4161d79c62df5bef35b0614238d0d2bd3051877a Building wheel for langdetect (setup.py) ... done Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993225 sha256=09f49cf026b6cdf7d53cde07d5cebd86c515ad7700f003405e8420dd9ee04c74 Stored in directory: /home/mike/.cache/pip/wheels/13/c7/b0/79f66658626032e78fc1a83103690ef6797d551cb22e56e734 Building wheel for wikipedia-api (setup.py) ... done Created wheel for wikipedia-api: filename=Wikipedia_API-0.5.4-py3-none-any.whl size=13476 sha256=6df36bf132e194bb22c392f40433e64681c5df6a0c4946b250c675158304217a Stored in directory: /home/mike/.cache/pip/wheels/ed/88/e3/da3d4d73cb91d659488cfa25913b84bbc26febec99d257bce9 Building wheel for overrides (setup.py) ... done Created wheel for overrides: filename=overrides-3.1.0-py3-none-any.whl size=10172 sha256=49e166626d2bb5c43c287b6a3d9fea8c9ed8449049f4911ea0350198972d51c1 Stored in directory: /home/mike/.cache/pip/wheels/6a/4f/72/28857f75625b263e2e3f5ab2fc4416c0a85960ac6485007eaa Successfully built torchfile bs4 gym networkx clang future iopath pyperclip termcolor wrapt gdown mpld3 word2number docopt sqlitedict langdetect wikipedia-api overrides Failed to build python-Levenshtein Installing collected packages: wrapt, word2number, wcwidth, typing-extensions, torchfile, tokenizers, termcolor, tensorflow-estimator, tensorboard-plugin-wit, sqlitedict, snowballstemmer, sentencepiece, pytz, pyperclip, pyglet, pyasn1, overrides, nlpaug, mpld3, lru-dict, keras, janome, ipython-genutils, iniconfig, flatbuffers, docopt, commonmark, clang, alabaster, zipp, xxhash, urllib3, traitlets, tqdm, torch, toml, threadpoolctl, terminaltables, tensorboard-data-server, tabulate, sphinxcontrib-serializinghtml, sphinxcontrib-qthelp, sphinxcontrib-jsmath, sphinxcontrib-htmlhelp, sphinxcontrib-devhelp, sphinxcontrib-applehelp, soupsieve, smart-open, six, setuptools, rsa, regex, PyYAML, python-magic, PySocks, pyparsing, pygments, pyDeprecate, pycparser, pyasn1-modules, py, protobuf, prompt_toolkit, portalocker, pluggy, pillow, orjson, oauthlib, numpy, num2words, multidict, more-itertools, MarkupSafe, lxml, llvmlite, konoha, kiwisolver, joblib, itsdangerous, imagesize, idna, gast, future, ftfy, fsspec, frozenlist, fonttools, filelock, editdistance, docutils, dill, deprecated, decorator, cycler, conllu, colorama, cloudpickle, click, charset-normalizer, cachetools, babel, attrs, async-timeout, yarl, Werkzeug, torchvision, tensorflow-hub, segtok, scipy, rich, requests, questionary, python-Levenshtein, python-dateutil, pyarrow, packaging, opt-einsum, numba, nltk, networkx, multiprocess, lemminflect, langdetect, keras-preprocessing, Jinja2, isodate, iopath, importlib-metadata, h5py, gym, grpcio, google-pasta, google-auth, contourpy, cmd2, cffi, beautifulsoup4, astunparse, aiosignal, absl-py, wikipedia-api, torchmetrics, sphinx, scikit-learn, requests-oauthlib, pytest, pandas, matplotlib, markdown, language-tool-python, hyperopt, huggingface-hub, gensim, flask, cryptography, bs4, azure-core, augly, aiohttp, transformers, sphinx-rtd-theme, msrest, lightgbm, google-auth-oauthlib, gdown, datasets, bpemb, adversarial-robustness-toolbox, tensorboard, flair, bert-score, azure-storage-blob, textattack, tensorflow, pytorch_lightning, tensorflow-text Attempting uninstall: setuptools Found existing installation: setuptools 65.5.0 Uninstalling setuptools-65.5.0: Successfully uninstalled setuptools-65.5.0 Running setup.py install for python-Levenshtein ... error error: subprocess-exited-with-error

    × Running setup.py install for python-Levenshtein did not run successfully. │ exit code: 1 ╰─> [34 lines of output] running install /home/mike/anaconda3/envs/counterfit/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. warnings.warn( running build running build_py creating build creating build/lib.linux-x86_64-3.8 creating build/lib.linux-x86_64-3.8/Levenshtein copying Levenshtein/StringMatcher.py -> build/lib.linux-x86_64-3.8/Levenshtein copying Levenshtein/init.py -> build/lib.linux-x86_64-3.8/Levenshtein running egg_info writing python_Levenshtein.egg-info/PKG-INFO writing dependency_links to python_Levenshtein.egg-info/dependency_links.txt writing entry points to python_Levenshtein.egg-info/entry_points.txt writing namespace_packages to python_Levenshtein.egg-info/namespace_packages.txt writing requirements to python_Levenshtein.egg-info/requires.txt writing top-level names to python_Levenshtein.egg-info/top_level.txt reading manifest file 'python_Levenshtein.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no previously-included files matching '*pyc' found anywhere in distribution warning: no previously-included files matching '*so' found anywhere in distribution warning: no previously-included files matching '.project' found anywhere in distribution warning: no previously-included files matching '.pydevproject' found anywhere in distribution adding license file 'COPYING' writing manifest file 'python_Levenshtein.egg-info/SOURCES.txt' copying Levenshtein/_levenshtein.c -> build/lib.linux-x86_64-3.8/Levenshtein copying Levenshtein/_levenshtein.h -> build/lib.linux-x86_64-3.8/Levenshtein running build_ext building 'Levenshtein._levenshtein' extension creating build/temp.linux-x86_64-3.8 creating build/temp.linux-x86_64-3.8/Levenshtein gcc -pthread -B /home/mike/anaconda3/envs/counterfit/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/mike/anaconda3/envs/counterfit/include/python3.8 -c Levenshtein/_levenshtein.c -o build/temp.linux-x86_64-3.8/Levenshtein/_levenshtein.o unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1 [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip. error: legacy-install-failure

    × Encountered error while trying to install package. ╰─> python-Levenshtein

    note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure.

    Type: Bug 
    opened by mikemishal 5
  • support for non probability outputs

    support for non probability outputs

    Hi there, very nice project, is there a plan to implement also attacks that works on the label output (no probabilities) or limited API query setting? There was an article here a while ago which would be nice to have. Is this something that should be implemented in the ART component?

    opened by priamai 5
  • TextAttack API changed

    TextAttack API changed

    Hello, I've just started using this library and things were working for a few days, but I think there's been an API change in TextAttack which broke it (ART works OK).

    When I try to load textattack, it can't find some embeddings files:

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/alzotolalgo.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/bae.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/bert.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/camrwr.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/deepwordbug.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/improved_ga.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/InputReduction.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/Kuleshov2017.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/pwws.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/textbugger.py: Could not find word_embeddings\paragramcf on server.

    textattack: Downloading https://textattack.s3.amazonaws.com/word_embeddings\paragramcf.

    [!] Failed to load counterfit/frameworks/textattack/textfooler.py: Could not find word_embeddings\paragramcf on server.

    [+] Framework loaded successfully!

    It finishes by saying the library loaded successfully, but list attacks gives

    [!] No frameworks have been loaded. Try 'load '.

    It was working at least 24 hours ago, so it looks like it might be the most recent TextAttack commit.

    opened by einderyl 4
  • Problem running counterfit.py

    Problem running counterfit.py

    Hi,

    after successfully running the requirements, and loading up the counterfeit environment, I receive the following error when trying to run counterfit.py

    'ImportError: cannot import name '_status_message' from 'scipy.optimize.optimize'

    Looking to try and fix this and get counterfit running again. This is on a mac. I've tried different versions of scipy, but can't find one that will work with this.

    Thanks!

    opened by Hobstarr 3
  • Info about the credit card fraud target

    Info about the credit card fraud target

    Hi there, Would be nice to provide some info about the credit card target example. We know it's 30 vector size, but what was the training set and what methods was used for classification? Cheers.

    opened by robomotic 3
  • EXCEPTION of type 'AttributeError' occurred with message: 'list' object has no attribute 'shape'

    EXCEPTION of type 'AttributeError' occurred with message: 'list' object has no attribute 'shape'

    I installed Counterfit using Option 2. While I am going through 'Basic Use' example, I got this Exception. Any suggestions.

    File "C:.....\Anaconda3\envs\counterfit\lib\site-packages\art\utils.py", line 534, in check_and_transform_label_format if len(labels.shape) == 2 and labels.shape[1] > 1: AttributeError: 'list' object has no attribute 'shape' EXCEPTION of type 'AttributeError' occurred with message: 'list' object has no attribute 'shape'

    opened by lzomlot 3
  • Integration of secml-malware inside CounterFit

    Integration of secml-malware inside CounterFit

    This pull request will add the possibility of using some functionalities of SecML Malware inside CounterFit. The users is then able to use the load secml command for loading the framework inside CounterFit, and then use some attacks (header perturbation attacks, PE format attacks, GAMMA attacks). It also enables the usage of malware classifiers, as MalConv and GBDT trained on EMBER (MalConv is provided inside the library, while the user would need the tree weights stored inside the library, inside a particular folder).

    opened by zangobot 3
  • Counterfithelpline@microsoft.com email does not work

    [email protected] email does not work

    [email protected] email does not work. I get this error:

    Message blocked

    Your message to [email protected] has been blocked. See technical details below for more information.

    I have also confirmed this with Aasim at MS Azure support and you may be hearing from him, too. He suggested I enter this here, too.

    I was going to ask in the email where I can get more information on the Attack Parameters. I have checked the wiki and other resources and I seem to be unable to find more. Thank you for anything you can do here. My email is [email protected] if you want to reach me that way. Thank you for a great tool and I would enjoy contributing.

    Paul Starrett

    Type: Question 
    opened by pstarconsult 2
  • AttributeError with moviereviews tutorial

    AttributeError with moviereviews tutorial

    Running the moviereviews tutorial (interact moviereviews, use deepwordbug, run) throws the following exception:

    Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/cmd2/cmd2.py", line 2063, in onecmd_plus_hooks stop = self.onecmd(statement, add_to_history=add_to_history) File "/usr/local/lib/python3.7/dist-packages/cmd2/cmd2.py", line 2493, in onecmd stop = func(statement) File "/usr/local/lib/python3.7/dist-packages/cmd2/decorators.py", line 318, in cmd_wrapper return func(*args_list, **kwargs) File "/content/counterfit/commands/run.py", line 56, in do_run CFState.get_instance().active_target.run_attack(logging=args.log) File "/content/counterfit/core/targets.py", line 194, in run_attack resulting_samples = self._run_attack(logging) # call the specific method File "/content/counterfit/core/targets.py", line 306, in _run_attack return self._run_textattack_attack(logging) File "/content/counterfit/core/targets.py", line 296, in _run_textattack_attack results_iter = attack_cls.attack_dataset( AttributeError: 'Attack' object has no attribute 'attack_dataset' EXCEPTION of type 'AttributeError' occurred with message: 'Attack' object has no attribute 'attack_dataset'

    I get the same error when I try with a different text classifier and dataset, so I think it might be one of the recent TextAttack commits? It ran fine until the first Friday commit. ART still loads and works fine.

    opened by einderyl 2
  • Contact email counterfithelpline@microsoft.com does not exist and emails sent to it are undeliverable

    Contact email [email protected] does not exist and emails sent to it are undeliverable

    Describe Contact email [email protected] does not exist and emails sent to it are undeliverable. Sent from @tylermneher and CC’d on it we’re @westover and @thinkula - all three of us members of @neherdata

    To Reproduce Steps to reproduce the behavior:

    1. Send an email to [email protected] as is listed on the bottom of README.md
    2. See error upon email bounce back.

    Expected behavior Email to be delivered to listed address

    Stack trace

    <div class="x-apple-transform-wrapper" style="font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-tap-highlight-color: rgba(26, 26, 26, 0.3); -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-family: UICTFontTextStyleBody; font-size: 15px; background-color: rgb(255, 255, 255); height: 1228.065693px;">
    
    Original Message Details
    --
    Created Date:12/25/2022 12:14:06 PMSender Address:[email protected] Address:[email protected]:request for more information | Created Date: | 12/25/2022 12:14:06 PM | Sender Address: | [email protected] | Recipient Address: | [email protected] | Subject: | request for more information
    Created Date: | 12/25/2022 12:14:06 PM
    Sender Address: | [email protected]
    Recipient Address: | [email protected]
    Subject: | request for more information
    Error Details
    Reported error:550 5.4.1 Recipient address rejected: Access denied. AS(201806281) [BL2NAM06FT011.Eop-nam06.prod.protection.outlook.com]DSN generated by:DM4PR11MB8227.namprd11.prod.outlook.com | Reported error: | 550 5.4.1 Recipient address rejected: Access denied. AS(201806281) [BL2NAM06FT011.Eop-nam06.prod.protection.outlook.com] | DSN generated by: | DM4PR11MB8227.namprd11.prod.outlook.com
    Reported error: | 550 5.4.1 Recipient address rejected: Access denied. AS(201806281) [BL2NAM06FT011.Eop-nam06.prod.protection.outlook.com]
    DSN generated by: | DM4PR11MB8227.namprd11.prod.outlook.com
    
    </div><p style="font-style: normal; font-variant-caps: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-tap-highlight-color: rgba(26, 26, 26, 0.3); -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none; caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); font-family: &quot;Segoe UI&quot;, Frutiger, Arial, sans-serif; font-size: 17px; font-weight: 500; padding-top: 4px; padding-bottom: 0px; margin-top: 19px; margin-bottom: 5px;">Original Message Headers</p><pre style="font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; widows: auto; word-spacing: 0px; -webkit-tap-highlight-color: rgba(26, 26, 26, 0.3); -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none; font-size: 15px; background-color: rgb(255, 255, 255); color: gray; white-space: pre; padding-top: 0px; margin-top: 5px;">ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=<span dir="ltr">microsoft.com</span>; cv=none;
     b=UaLcfCXSy8HHoaiEeD5WFRXs+fX36Rn6FVODAW0y4zf/aQpPZEEmshl0YKZEW3yGfozUTwM8PqLToBfxP7V3yYeCwMn/BceKmTZb4fJhiECwOQYvu5hMajmfqk5DIJS0dls1OLF5HN8hWrUuAvpMaspAt3XOysmKG/GQvizvV0ct5O7DfhwxUKaR95e30X43AKglExaW0+VvAH/LPpitQzjYIyWijjhdtP9dYFo45u8vvpBDbkWU6XFpRqqY0mxDqaBJpH7apugpetZvhgtKQ5zPfEfKyCwotLxOZiX5Omla6D2Ed4qxjzU4s+kimX7tOdi4Ttq+ruclAmcSmpj5qg==
    ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=<span dir="ltr">microsoft.com</span>;
     s=arcselector9901;
     h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
     bh=OmMM8fx8TwkfRSb1jK2MEtTleiMqWi6afyXfaacIKSs=;
     b=cdcXhaAOHz6LOxPTiyDctZSs15e/1luclRnkXde04GAdeu9EIaDLzyj1bs7vDzxETZMRbnv0JW8gQZIvjG8n9aqwQGkld3CB8QtDSfTrBuezJGNxq0/Zgb2J7nW0rxr4wFfn89tkjeZxS0d/Tr+QdiDajzUbIz2G91lBvYW7kwlqLZjQAoZcqEC+g5K34i80vbicyGbcgqmj5n6mhBCJqKh1lrTRYPFI4q6mvJbt9QXUGyy9B2TheIAlnVFZYHw5dpl9ZDTjUPq4TzHTp/j1glruZfH0mu0gwCtxL8zxOGM5RJqwuBh+yD0PbXqOQYojwt6jIcrz1Sf8mIlDXjT3Jg==
    ARC-Authentication-Results: i=1; <span dir="ltr">mx.microsoft.com</span> 1; spf=pass
     smtp.mailfrom=<span dir="ltr">neherdata.com</span>; dmarc=pass action=none
     header.from=<span dir="ltr">neherdata.com</span>; dkim=pass header.d=<span dir="ltr">neherdata.com</span>; arc=none
    DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=<span dir="ltr">neherdata.com</span>;
     s=selector1;
     h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
     bh=OmMM8fx8TwkfRSb1jK2MEtTleiMqWi6afyXfaacIKSs=;
     b=N9HOraER/+KYu3bJ0EQsAHcWdAu3Z800yqCcBJmvv1NKx20r/K2dB/thPjTPduy8KqahSReorhfSu9UaPhIKlrlugvCaCWfGW1nGvxl6NUaXly/7BbKZR4vCgMiHCawVdrPiTlOw+4E3U2hNNwIsnwVSpnFFTYTcPlJH8kQ1jOkX2zeGk7jMRG586k8QLzQFNY6IVEWf9V6Z6SaTzq+1Z7HB5JHnl+Y1VwjphwMQ4K+spn0A1WF6g+ooXic5atT+5hUd8xwwfcFk4UfirLgxL4A0E9DsKaNXwXfJdJDdybsvexlUNOxReKHah1tfEHv8TGOl7lpJYfZ7hNz7+19cGg==
    Received: from <span dir="ltr">DM8PR11MB5653.namprd11.prod.outlook.com</span> (2603:10b6:8:25::8) by
     <span dir="ltr">DM4PR11MB8227.namprd11.prod.outlook.com</span> (2603:10b6:8:184::10) with Microsoft
     SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
     <span dir="ltr">15.20.5944.12</span>; Sun, 25 Dec 2022 12:14:07 +0000
    Received: from <span dir="ltr">DM8PR11MB5653.namprd11.prod.outlook.com</span>
     ([fe80::4207:1798:c852:8fb4]) by <span dir="ltr">DM8PR11MB5653.namprd11.prod.outlook.com</span>
     ([fe80::4207:1798:c852:8fb4%6]) with mapi id 15.20.5944.016; Sun, 25 Dec 2022
     12:14:07 +0000
    From: "Tyler M. Neher" &lt;<span dir="ltr">[email protected]</span>&gt;
    To: "<span dir="ltr">[email protected]</span>" &lt;<span dir="ltr">[email protected]</span>&gt;
    CC: Joe Ugalde &lt;<span dir="ltr">[email protected]</span>&gt;, James Westover &lt;<span dir="ltr">[email protected]</span>&gt;
    Subject: request for more information
    Thread-Topic: request for more information
    Thread-Index: AQHZGFpiMPnsifxvPE2398qfV3yxOQ==
    Date: Sun, 25 Dec 2022 12:14:06 +0000
    Message-ID: &lt;<span dir="ltr">[email protected]</span>&gt;
    Accept-Language: en-US
    Content-Language: en-US
    X-MS-Has-Attach:
    X-MS-TNEF-Correlator:
    authentication-results: dkim=none (message not signed)
     header.d=none;dmarc=none action=none header.from=<span dir="ltr">neherdata.com</span>;
    x-ms-publictraffictype: Email
    x-ms-traffictypediagnostic: DM8PR11MB5653:EE_|DM4PR11MB8227:EE_
    x-ms-office365-filtering-correlation-id: 1ff1dd2e-4e05-43dd-e0da-08dae6718550
    x-ms-exchange-senderadcheck: 1
    x-ms-exchange-antispam-relay: 0
    x-microsoft-antispam: BCL:0;
    x-microsoft-antispam-message-info: YZKmliwgFnMyfiKVX2l8iTYTgRsGvDlv1m7uDXv1YbJgPBw5ct9tygW6fc8nsPhCI3Uh4rZSybiPcD/DhlpUnTpzk/Hab/azB2uMsntCpuGqSejvgyS0d67pJUd+IS3o0zf+H+Qg6N4lSI2DktIsG1CslJRsS6NT4lfcckZ+3AmLMRsKucwbb3jrENebiBUCTvxB/Ugg1bBzo1eqgvzDTV/QKWomDgCQyO3RgRlBiz5WHK4Ud5Z0YmDD5HWlo1z8pZ1DFiqaeMwYYvNJAzNe+uAQzp1rlV89o1qazuVdrs7JBz9jJPuNYo3JeImEKBICoXgzSMuJUbz/frEM350b0CvI+XWjKrniWwyfDrYDDzkXo+6l+cxVAe6xMfSanIMzO+SkUWeZcOygitKO1HB9U8minbqK9ojvJFWAsUZM4LndYT7hykkZBCzgEl1WkIQfZi0snVGpUd10DueSVV8lEjWxKa2Af7lm+Fc2ieHF2vDyXVMoKPDUjQmON59lKaOsjCAVtiDQACqYZ8zwtNoyUvv4nyMC/6JyzHBzhtz/faPyiGRsvS3APFDsLpzDFIlKZqFTS34SisSbjA939WDMiG5LOXUos4NXhla1nlHRyyCKtDDOP1pjG4rZA5lWc2IPC471kwd1XHa8EsYD4rQkatdFWQB6rPsg0188zS95u8YQe6KOCNp0XD61vBR1ep6NRcxBTXUlvBv/SDcp5giwLItQgyVST0u8i+N34sp79qg=
    x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:<span dir="ltr">DM8PR11MB5653.namprd11.prod.outlook.com</span>;PTR:;CAT:NONE;SFS:(<span dir="ltr">13230022</span>)(<span dir="ltr">4636009</span>)(376002)(136003)(346002)(366004)(<span dir="ltr">39830400003</span>)(396003)(<span dir="ltr">451199015</span>)(<span dir="ltr">45080400002</span>)(<span dir="ltr">66946007</span>)(<span dir="ltr">76116006</span>)(<span dir="ltr">4326008</span>)(<span dir="ltr">66556008</span>)(<span dir="ltr">66476007</span>)(<span dir="ltr">91956017</span>)(<span dir="ltr">8676002</span>)(<span dir="ltr">6916009</span>)(<span dir="ltr">2616005</span>)(<span dir="ltr">64756008</span>)(<span dir="ltr">38100700002</span>)(<span dir="ltr">54906003</span>)(316002)(<span dir="ltr">36756003</span>)(<span dir="ltr">3480700007</span>)(<span dir="ltr">2906002</span>)(<span dir="ltr">86362001</span>)(<span dir="ltr">8936002</span>)(<span dir="ltr">122000001</span>)(<span dir="ltr">83380400001</span>)(<span dir="ltr">33656002</span>)(<span dir="ltr">5660300002</span>)(<span dir="ltr">4744005</span>)(<span dir="ltr">41300700001</span>)(<span dir="ltr">40140700001</span>)(<span dir="ltr">66446008</span>)(<span dir="ltr">478600001</span>)(<span dir="ltr">6506007</span>)(<span dir="ltr">71200400001</span>)(166002)(<span dir="ltr">6486002</span>)(<span dir="ltr">107886003</span>)(186003)(<span dir="ltr">6512007</span>)(<span dir="ltr">38070700005</span>)(<span dir="ltr">45980500001</span>);DIR:OUT;SFP:1101;
    x-ms-exchange-antispam-messagedata-chunkcount: 1
    x-ms-exchange-antispam-messagedata-0: =?utf-8?B?WkE0YXp0WWtTL1BwR3pYS1ZQejFYSEFYV0VkejJWYWlZWEZ3b003c1pjUWhT?=
     =?utf-8?B?YjdyWnFrN1BCTTJTVGs0WXZpeS9BQ2ZsYXU5am8wdGtURlZ5a2pqbGtFU1NB?=
     =?utf-8?B?T2xmOTBhdXRhUjl2RlpnMnBWSVJieXpTZWNuYVh3dVRwVWJUTWt2RjE1Z1NW?=
     =?utf-8?B?WmFlQWFmN0JrYllDT2d1S2ZhK3NCWWRNemVPb1h4WDB5WkRFanEwOWZxaEFN?=
     =?utf-8?B?SS9ucXkrcGNodWl6RFM3RWhFM0NlS3pCbjcwQThtWVhPV21TMVlDampVQ0F3?=
     =?utf-8?B?dU1mTEVRcHg4Qi9RRTFIUmpvWm9VaUFVeGtPY09zRmRXYlg1VFQvWXVZWmgy?=
     =?utf-8?B?WTZoeUZsQ1gxbXpSQ1ZtTXROYU0wcU5uU2dWRkNXWGtZSk1QaHZwTG5PdHBG?=
     =?utf-8?B?cklxcENjbCt2YzhHeXhxM3d3dVBNdEIzNEJ4dnJQOTNFeVJnUXhOcTVsUkdZ?=
     =?utf-8?B?T2p6ZlpxV25iY002a3gySWU1eWpNWEVSM2RrZ21Ka0FFcEVST2thejNVTE40?=
     =?utf-8?B?dEpSb0VTRDA3aUR6S2NlMnZjN1ZsNGJvejYrQy9uakZLM2lLVDMyRC81ekhh?=
     =?utf-8?B?d0E5RWFndE9RdnhYOWpxQ0F4Y2lNYW9jTHFzMHpsRmZPdVNta0ZzUjEyY3oz?=
     =?utf-8?B?dGpvbUhmYzZZTGhUS3QyUXdmOEgzL2MzRUt0ZDMvemdaVjZWZTN1b0ZVMXor?=
     =?utf-8?B?dXRYSjczMWU4TW1Ea1dKQ2FjQ2RBaVlkNEZQTnFGM1N1NmdoY3hDNDRvaG9J?=
     =?utf-8?B?L2ZpNHdzcnBoMUQ0aTJGLytGRlY5YndhT2ZvMEVlRHJiWVNSWXJtUHZCdkgr?=
     =?utf-8?B?UHdsZ0ZCV3RkNXdoYmtHUUtVVFhNTnJ0RFY5ZDJyMUxOVThEOG85Q1dUanZr?=
     =?utf-8?B?a2Irb1ljNkFFTTdQT3h3QzlPeDI3WHVnUzczUk5oZm5KaVVQUHdZZ0k0aGoy?=
     =?utf-8?B?bDhnRWFPeFZnajNienpnM2wrZE9UQktXWHlEUXlGdjlMNDJvUEVZZmVrUDA0?=
     =?utf-8?B?TG9VWnMrTVBKeVB1SGtoUlFEMG42ZHRHZ0I1WEF1YTd5Y2krUlBtekJNLzUv?=
     =?utf-8?B?aXhWSnVXNUI5c1VjRkQwcmlrUStjRGF3NitZbUpsaFZRamVENGdHYzh0aXpi?=
     =?utf-8?B?dEZiL2NqQjJETWxvVEIzMjJRMExHMHJ5QzVQUVYwdTQwbWxWWGdGQjVUU3hE?=
     =?utf-8?B?UmRaS3BFMHhlNU9PdG55dUp4ZlM4V3Rqd1paZXRuYnZrZnhKR1BHZE5oT0dG?=
     =?utf-8?B?UGlzc2NoelNFUkllQzZsUEtPbUtsTlBZQXZraTRJMXpnRyttdTY1VWFJR0Fh?=
     =?utf-8?B?RHJHbzFkVmdXK3Y5ays3ZnhJR3lvS3U3RElsZEFqbWlKRUxzVWQrcG5sVTQv?=
     =?utf-8?B?bE5lQU82bFFUTWczdU8rbFJDeVBtUWZuOE9nY09YUGlQNi9qZkVVNWt3dFp2?=
     =?utf-8?B?cVhVZVJsM3Nmd1kxU0NqbXVpOFhWbDBCRmRMQUIrb1RnalZnbE96VW5aMWxu?=
     =?utf-8?B?cTJ1dTgwNUZpQ21ZUDNNMVlkTUN6R1JBUTFya2o4ZkRpK2h1OStrRFZtc3dO?=
     =?utf-8?B?L1kvdW13eGVMRDhkRUlTUktLbDIzTlZBL2F0cWNsTS93eU5wTUQyMmZ2OTFR?=
     =?utf-8?B?a05HK1FMVyt0RXJPeFV3dDc2S0VOYXVvTi9DUHpDTTRxNmxoc0U4ZzZVSUxB?=
     =?utf-8?B?aC9SZE82UU1yV1pGbFBlNTlRRm03Z1h5M3VQOFpPUFlBT2VhU2lYTndWZUE3?=
     =?utf-8?B?d0hRa21yTW83dmlWWkpwOTlTS1BPMlJ5Zkt1WEsrTWJjRGpSUjNDa3paWjBn?=
     =?utf-8?B?VnZqUWVBVFprbmYwRE9TYlg1VTBHZHJ0UHI2UDVlRzZLekZJUjRsdXZXN2F6?=
     =?utf-8?B?b2tRcXRLc0hHaHA4M0w0UXdLNzIzYktubFZ6L1dZdUJBSlV2R2wzSHZ0cmF4?=
     =?utf-8?B?WWx6cTVMY1V4VVp4WVJXSWhzTEU2YzFRVk00YTFLdGQ4b2tRQzJYVUhUeTJM?=
     =?utf-8?B?WnE2WEhhdGxidHJTcW5HNEdGR0lwNVZqVzhsbUptazFCdkFhVWk4RStiZzV6?=
     =?utf-8?B?NTk3TU9VekQ1clRhMWVoelptL3pOSjUremxlRFU2ZStORENTRE5rV3lZRnJ3?=
     =?utf-8?B?cG9YeWNVWkhNaUFhUE15WlljTjBVL2QwTFg2M3dPczdCckNkMHRMMUExSTFN?=
     =?utf-8?Q?r3Inbx9qRUXmDfax0qsgmCyJ6KCK2cNXmb2o/u9UYT84?=
    Content-Type: multipart/alternative;
    	boundary="_000_67807CC935D344F1A44BC5545A899C7Eneherdatacom_"
    MIME-Version: 1.0
    X-OriginatorOrg: <span dir="ltr">neherdata.com</span>
    X-MS-Exchange-CrossTenant-AuthAs: Internal
    X-MS-Exchange-CrossTenant-AuthSource: <span dir="ltr">DM8PR11MB5653.namprd11.prod.outlook.com</span>
    X-MS-Exchange-CrossTenant-Network-Message-Id: 1ff1dd2e-4e05-43dd-e0da-08dae6718550
    X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Dec 2022 12:14:06.8085
     (UTC)
    X-MS-Exchange-CrossTenant-fromentityheader: Hosted
    X-MS-Exchange-CrossTenant-id: d770fcbe-d7dc-4cf8-8745-7d857be6c7ac
    X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
    X-MS-Exchange-CrossTenant-userprincipalname: IUWziK5r3bB8XlnOqS0tMD9srxYnqlqt9htEIkfA0vOs1OON2QBh5B8eNP44H9gkn8zogefDMY6jPAir3D8Rmw==
    X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR11MB8227
    </pre><br class="Apple-interchange-newline" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-tap-highlight-color: rgba(26, 26, 26, 0.3); -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;"><br class="Apple-interchange-newline">
    

    Screenshots page 1 page 4 page 2 page 3

    Desktop (please complete the following information):

    • OS: Mail for iOS
    • Version: iOS 16.2 (20C65)

    Additional context

    Type: Bug 
    opened by tylermneher 1
  • Bump tensorflow from 2.10.0 to 2.10.1

    Bump tensorflow from 2.10.0 to 2.10.1

    Bumps tensorflow from 2.10.0 to 2.10.1.

    Release notes

    Sourced from tensorflow's releases.

    TensorFlow 2.10.1

    Release 2.10.1

    This release introduces several vulnerability fixes:

    Changelog

    Sourced from tensorflow's changelog.

    Release 2.10.1

    This release introduces several vulnerability fixes:

    Release 2.9.3

    This release introduces several vulnerability fixes:

    ... (truncated)

    Commits
    • fdfc646 Merge pull request #58581 from tensorflow-jenkins/version-numbers-2.10.1-4527
    • 319f094 Update version numbers to 2.10.1
    • 7c857b8 Merge pull request #58475 from tensorflow-jenkins/relnotes-2.10.1-6649
    • 6f133da Update RELEASE.md
    • 3982264 Merge pull request #58573 from tensorflow/r2.10-f856d02e532
    • f425d38 Merge pull request #58571 from tensorflow/r2.10-7b174a0f2e4
    • dbe4291 Merge pull request #58569 from tensorflow/r2.10-216525144ee
    • 965517a Merge pull request #58565 from tensorflow/r2.10-af4a6a3c8b9
    • c09738e Merge pull request #58564 from tensorflow/r2.10-9f03a9d3baf
    • 3da111c Merge pull request #58561 from tensorflow/r2.10-8310bf8dd18
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies 
    opened by dependabot[bot] 0
  • Bump pillow from 9.2.0 to 9.3.0

    Bump pillow from 9.2.0 to 9.3.0

    Bumps pillow from 9.2.0 to 9.3.0.

    Release notes

    Sourced from pillow's releases.

    9.3.0

    https://pillow.readthedocs.io/en/stable/releasenotes/9.3.0.html

    Changes

    ... (truncated)

    Changelog

    Sourced from pillow's changelog.

    9.3.0 (2022-10-29)

    • Limit SAMPLESPERPIXEL to avoid runtime DOS #6700 [wiredfool]

    • Initialize libtiff buffer when saving #6699 [radarhere]

    • Inline fname2char to fix memory leak #6329 [nulano]

    • Fix memory leaks related to text features #6330 [nulano]

    • Use double quotes for version check on old CPython on Windows #6695 [hugovk]

    • Remove backup implementation of Round for Windows platforms #6693 [cgohlke]

    • Fixed set_variation_by_name offset #6445 [radarhere]

    • Fix malloc in _imagingft.c:font_setvaraxes #6690 [cgohlke]

    • Release Python GIL when converting images using matrix operations #6418 [hmaarrfk]

    • Added ExifTags enums #6630 [radarhere]

    • Do not modify previous frame when calculating delta in PNG #6683 [radarhere]

    • Added support for reading BMP images with RLE4 compression #6674 [npjg, radarhere]

    • Decode JPEG compressed BLP1 data in original mode #6678 [radarhere]

    • Added GPS TIFF tag info #6661 [radarhere]

    • Added conversion between RGB/RGBA/RGBX and LAB #6647 [radarhere]

    • Do not attempt normalization if mode is already normal #6644 [radarhere]

    ... (truncated)

    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    • @dependabot use these labels will set the current labels as the default for future PRs for this repo and language
    • @dependabot use these reviewers will set the current reviewers as the default for future PRs for this repo and language
    • @dependabot use these assignees will set the current assignees as the default for future PRs for this repo and language
    • @dependabot use this milestone will set the current milestone as the default for future PRs for this repo and language

    You can disable automated security fix PRs for this repo from the Security Alerts page.

    dependencies 
    opened by dependabot[bot] 0
  • Why ['initial']['input'] and ['final']['input'] are the same?

    Why ['initial']['input'] and ['final']['input'] are the same?

    Hello @moohax , I found in your wiki that evasion attack attempts to alter inputs such that the model gives an incorrect output. However, when I trying with evasion attack hop skip jump, I found that ['initial']['input'] and ['final']['input'] are the same, I thought they should be different from each other right? Additionally, although the two inputs are the same, ['initial']['output'] and ['final']['output'] are different from each other, could you please tell me the reason? I cannot find the place where ['initial']['output'] and ['final']['output'] comes from. Thank you.

    opened by jiansuozhe 1
  • Issues when adding new attacks into the old version of Counterfit

    Issues when adding new attacks into the old version of Counterfit

    Hello @moohax,

    I'm sorry that I am not sure if you have seen my questions so I opened a new issue.

    I am trying to add new attacks to the old version of Counterfit (There is no extraction attack and inference attack in the old version). Could you please give me some tips?

    For instance, I consulted the config file in the new Counterfit version and tried to create a new file for utilizing Functionally Equivalent Extraction attack from ART in the old version. Could you please tell me if I need to add some new information in the file? Thank you. WeChat Screenshot_20220428023650 WeChat Screenshot_20220428024236

    opened by jiansuozhe 2
  • Samples only set once

    Samples only set once

    Branch: develop/1.1

    https://github.com/Azure/counterfit/blob/ff4f3c7c593856830e5a9b07bd1627f71fbcfc61/counterfit/core/attacks.py#L51

    Getting samples happens in cfattack.__init__. It should happen in cfattack.prepare_attack which is called before the attack is run in core.run_attack.

            # Get the samples.
            self.samples = target.get_samples(
                self.options.cf_options["sample_index"]["current"]
            )
    
    opened by moohax 0
Releases(v1.1.0)
  • v1.1.0(Nov 14, 2022)

    What's new in Counterfit v1.1.0

                                  __            _____ __
          _________  __  ______  / /____  _____/ __(_) /_
         / ___/ __ \/ / / / __ \/ __/ _ \/ ___/ /_/ / __/
        / /__/ /_/ / /_/ / / / / /_/  __/ /  / __/ / /
        \___/\____/\__,_/_/ /_/\__/\___/_/  /_/ /_/\__/
    
                        Version: 1.1.0
            
    

    We're thrilled to announce a new release version for Counterfit! 🚀

    1. Counterfit as a package

    • Counterfit can now be used from within a Python script.
    • Access to all of the targets and attacks that the Counterfit CLI supports.
    import counterfit
    import counterfit.targets as cf_targets
    
    
    digits_target = cf_targets.Digits()
    digits_target.load()
    cf_attack = counterfit.Counterfit.build_attack(digits_target, 'hop_skip_jump')
    results = counterfit.Counterfit.run_attack(cf_attack)
    

    2. Updates to Counterfit CLI

    • Counterfit CLI now automatically loads attacks and frameworks.
    • Two new sample targets that show you how to attack reinforcement learning. i.e. Cart Pole targets.
    $ counterfit
                              __            _____ __
      _________  __  ______  / /____  _____/ __(_) /_
     / ___/ __ \/ / / / __ \/ __/ _ \/ ___/ /_/ / __/
    / /__/ /_/ / /_/ / / / / /_/  __/ /  / __/ / /
    \___/\____/\__,_/_/ /_/\__/\___/_/  /_/ /_/\__/
    
                    Version: 1.1.0
    
    counterfit> list targets 
    ┏━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
    ┃ Name                ┃ Model Type ┃ Data Type ┃ Input Shape   ┃ # Samples ┃ Endpoint                                             ┃
    ┡━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
    │ cart_pole           │ closed-box │ tabular   │ (1080000,)    │ 0         │ cartpole_dqn_10000.pt.gz                             │
    │ cart_pole_initstate │ closed-box │ tabular   │ (4,)          │ 0         │ cartpole_dqn_10000.pt.gz                             │
    │ creditfraud         │ closed-box │ tabular   │ (30,)         │ 0         │ creditfraud/creditfraud_sklearn_pipeline.pkl         │
    │ digits_keras        │ closed-box │ image     │ (28, 28, 1)   │ 0.        │ digits_keras/mnist_model.h5                          │
    │ digits_mlp          │ closed-box │ image     │ (1, 28, 28)   │ 0         │ digits_mlp/mnist_sklearn_pipeline.pkl                │
    │ movie_reviews       │ closed-box │ text      │ (1,)          │ 0.        │ movie_reviews/movie_reviews_sentiment_analysis.pt    │
    │ satellite           │ closed-box │ image     │ (3, 256, 256) │ 0         │ satellite/satellite-image-params-airplane-stadium.h5 │
    └─────────────────────┴────────────┴───────────┴───────────────┴───────────┴──────────────────────────────────────────────────────┘
    
    counterfit> set_target satellite
    
    satellite> set_attack hop_skip_jump 
    [+] success:  Using fb58020f
    
    satellite>HopSkipJump:fb58020f> show info
    ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
    ┃ Attack Field ┃ Description                                                                                                                                               ┃
    ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
    │ Name         │ hop_skip_jump                                                                                                                                             │
    │ Type         │ closed-box                                                                                                                                                │
    │ Category     │ evasion                                                                                                                                                   │
    │ Tags         │ image, tabular                                                                                                                                            │
    │ Framework    │ art                                                                                                                                                       │
    │ Docs         │ Implementation of the HopSkipJump attack from Jianbo et al. (2019). This is a powerful closed-box attack that only requires final class prediction, and   │
    │              │ is an advanced version of the boundary attack. | Paper link: https://arxiv.org/abs/1904.02144                                                             │
    └──────────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
    
    satellite>HopSkipJump:fb58020f> run
    HopSkipJump:   0%|                                                                                                                                    | 0/1 [00:00<?, ?it/sFailed to draw a random image that is adversarial, attack failed.
    HopSkipJump: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:04<00:00,  4.88s/it]
    [+] success:  Attack completed fb58020f
    
    
    
    

    3. Update to internal architecture

    • Internal Counterfit repository is updated to be more extensible and easier to understand.
    • Updated targets and attacks naming convention.
    • Adds framework for integration tests before pull-requests can be merged to main.

    4. Support for Reinforcement Learning attacks

    • Counterfit leverages OpenAI gym to use different attacks on Reinforcement Learning (RL) targets such as Cart Pole.
    • Allow Windows and Linux users with a GUI to see the live attack on the Cart Pole target.
    • Counterfit can run in headless mode to attack Cart Pole target when no GUI available.
    • See demo example on the Hands-on Hacking of Reinforcement Learning Systems demo in our Counterfit Examples document.

    The not so fine print: Please read!

    Release v.1.1.0 of Counterfit is not backwards compatible with Counterfit v1.0.0. This is due to major changes in the architecture of the software and how Counterfit targets and attacks are loaded. The good news is that Counterfit v1.1.0 has fully ported all the previous attacks and targets.

    To improve the readability of the Counterfit command line interface (CLI), Counterfit v1.1.0 updates the naming convention of some of the commands while it deprecates others.

    • The interact command has been replaced with the more idiomatic set_target command.
    • The use command has been replaced with the more idiomatic set_attack command.
    • The set command has been replaced with the more idiomatic set_params command.
    • The load command has been deprecated. Frameworks and attacks are now automatically loaded by the CLI.
    Source code(tar.gz)
    Source code(zip)
  • v1.0.0(Oct 27, 2022)

                              __            _____ __
      _________  __  ______  / /____  _____/ __(_) /_
     / ___/ __ \/ / / / __ \/ __/ _ \/ ___/ /_/ / __/
    / /__/ /_/ / /_/ / / / / /_/  __/ /  / __/ / /
    \___/\____/\__,_/_/ /_/\__/\___/_/  /_/ /_/\__/
    
                                    v1.0    #ATML
    
    ---------------------------------------------------
    

    Description

    First and foremost, the ATML team would like the thank everyone for their support over the last few months. Counterfit recieved a very warm welcome from the community. What started as some simple red team tooling has become a place for collaboration, experiementatation, and of course security assessments. While verson 0.1 was useful, unless a user was familiar with the code, it was admitedly difficult to use beyond it's basic functionality. Users of Counterfit should know that their frustrations with the tool were also our frustrations. While our internal version may have different targets, custom algos, reporting, the public version of Counterfit is ultimately the base of our internal version. For those unfamiliar with infosec, this is a common practice that creates a shared experience. These shared experiences will allow us to communicate and come to a common understanding of risk in the ML space.

    Let's checkout the new digs. We will cover the changes at a high-level and get into details later,

    • Frameworks are a first-class concept.
    • New logging capabilities
    • Options structure
    • New attacks from art, textattack
    • New attacks via Augly
    • Various command functionality
    • Running via run_pyscript
    • New reporting structure
    • Python Rich integration
    • docs and tests

    Frameworks are a first-class concept

    Frameworks are the drivers behind Counterfit and they provide the functionality for Counterfit. Counterfit now takes a back seat and offloads the majority of work to the framework responsible for an attack. Frameworks are not loaded on start, rather by using the load command Like other objects in Counterfit, frameworks are built around their folder structure within the project. Each framework has its own folder under counterfit/frameworks.In order to be loaded by Counterfit, a framework should inherit from counterfit.core.frameworks.Framework. A framework should also define a number of core functions. These include load(), build(), run(), check_success(), pre_attack_proccessing(), post_attack_processing(). Everything begins and ends with a framework and so in order to add a new framework it is important to be familiar with some Counterfit internals.

    Python Rich integration

    Thanks to Python Rich, Counterfit has a lot more colors and is generally better looking. Rich requires that everything is string or a "renderable". Be aware of this when using the logging module.

    Notes

    A new version of Counterfit will be released in late October, 2022. To get the latest version of Counterfit, see release v1.1.0.

    Source code(tar.gz)
    Source code(zip)
Owner
Microsoft Azure
APIs, SDKs and open source projects from Microsoft Azure
Microsoft Azure
This projects provides the documentation and the automation(code) for the Oracle EMEA WLA COA Demo UseCase.

COA DevOps Training UseCase This projects provides the documentation and the automation(code) for the Oracle EMEA WLA COA Demo UseCase. Demo environme

Cosmin Tudor 1 Jan 28, 2022
CTF infrastructure deployment automation tool.

CTF infrastructure deployment automation tool. Focus on the challenges. Mirrored from

Fake News 1 Apr 12, 2022
Some automation scripts to setup a deployable development database server (with docker).

Postgres-Docker Database Initializer This is a simple automation script that will create a Docker Postgres database with a custom username, password,

Pysogge 1 Nov 11, 2021
A Blazing fast Security Auditing tool for Kubernetes

A Blazing fast Security Auditing tool for kubernetes!! Basic Overview Kubestriker performs numerous in depth checks on kubernetes infra to identify th

Vasant Chinnipilli 934 Jan 4, 2023
GitGoat enables DevOps and Engineering teams to test security products intending to integrate with GitHub

GitGoat is an open source tool that was built to enable DevOps and Engineering teams to design and implement a sustainable misconfiguration prevention strategy. It can be used to test with products with access to GitHub repositories without a risk to your production environment.

Arnica 149 Dec 22, 2022
Hubble - Network, Service & Security Observability for Kubernetes using eBPF

Network, Service & Security Observability for Kubernetes What is Hubble? Getting Started Features Service Dependency Graph Metrics & Monitoring Flow V

Cilium 2.4k Jan 4, 2023
Bugbane - Application security tools for CI/CD pipeline

BugBane Набор утилит для аудита безопасности приложений. Основные принципы и осо

GardaTech 20 Dec 9, 2022
More than 130 check plugins for Icinga and other Nagios-compatible monitoring applications. Each plugin is a standalone command line tool (written in Python) that provides a specific type of check.

Python-based Monitoring Check Plugins Collection This Enterprise Class Check Plugin Collection offers a package of more than 130 Python-based, Nagios-

Linuxfabrik 119 Dec 27, 2022
Helperpod - A CLI tool to run a Kubernetes utility pod with pre-installed tools that can be used for debugging/testing purposes inside a Kubernetes cluster

Helperpod is a CLI tool to run a Kubernetes utility pod with pre-installed tools that can be used for debugging/testing purposes inside a Kubernetes cluster.

Atakan Tatlı 2 Feb 5, 2022
A tool to convert AWS EC2 instances back and forth between On-Demand and Spot billing models.

ec2-spot-converter This tool converts existing AWS EC2 instances back and forth between On-Demand and 'persistent' Spot billing models while preservin

jcjorel 152 Dec 29, 2022
Inferoxy is a service for quick deploying and using dockerized Computer Vision models.

Inferoxy is a service for quick deploying and using dockerized Computer Vision models. It's a core of EORA's Computer Vision platform Vision Hub that runs on top of AWS EKS.

null 94 Oct 10, 2022
a CLI that provides a generic automation layer for assessing the security of ML models

Counterfit About | Getting Started | Learn More | Acknowledgments | Contributing | Trademarks | Contact Us -------------------------------------------

Microsoft Azure 575 Jan 2, 2023
A CLI tool to disable and enable security standards controls in AWS Security Hub

Security Hub Controls CLI A CLI tool to disable and enable security standards controls in AWS Security Hub. It is designed to work together with AWS S

AWS Samples 4 Nov 14, 2022
Generic automation framework for acceptance testing and RPA

Robot Framework Introduction Installation Example Usage Documentation Support and contact Contributing License Introduction Robot Framework is a gener

Robot Framework 7.7k Jan 7, 2023
Generic automation framework for acceptance testing and RPA

Robot Framework Introduction Installation Example Usage Documentation Support and contact Contributing License Introduction Robot Framework is a gener

Robot Framework 7.7k Dec 31, 2022
This repository describes our reproducible framework for assessing self-supervised representation learning from speech

LeBenchmark: a reproducible framework for assessing SSL from speech Self-Supervised Learning (SSL) using huge unlabeled data has been successfully exp

null 49 Aug 24, 2022
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset of 53,000+ Legal Holdings

When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset of 53,000+ Legal Holdings This is the repository for t

RegLab 39 Jan 7, 2023
Network Automation and Programmability Abstraction Layer with Multivendor support

NAPALM NAPALM (Network Automation and Programmability Abstraction Layer with Multivendor support) is a Python library that implements a set of functio

napalm-automation 2k Dec 31, 2022