Auditing Black-Box Prediction Models for Data Minimization Compliance

Bashir Rastegarpanah

Last update: Mar 24, 2022

Related tags

Deep Learning Data-Minimization-Auditor

Overview

Data-Minimization-Auditor

An auditing tool for model-instability based data minimization that is introduced in "Auditing Black-Box Prediction Models for Data Minimization Compliance" (Bashir Rastegarpanah, Krishna P. Gummadi, Mark Crovella; NeurIPS2021).

The implementation is in Python 3 and the main methods are in ('DM.py'). Given any prediction model that supports the scikit-learn interface style, this tool can be used to perform two types of probabilistic audits at a given confidence level: (i) measuring the greatest level of data minimization that can be guaranteed given a fixed budget of system queries, and (ii) verifying whether data minimization is satisfied at a given level. In the second case, the auditor keeps querying the prediction system until a decision can be made.

A Jupyter notebook that demonstrates how to reproduce the results presented in the experiments section (Sec 7) of the paper is also added to this repository. In order to use this package one needs to initiate an instance of the 'Auditor()' class whose parameters are a prediction model that provides the same interface as scikit-learn predictors, and some audit data as a pandas DataFrame.

A PyTorch implementation of Sharpness-Aware Minimization for Efficiently Improving Generalization

sam.pytorch A PyTorch implementation of Sharpness-Aware Minimization for Efficiently Improving Generalization ( Foret+2020) Paper, Official implementa

102 Dec 28, 2022

ICLR21 Tent: Fully Test-Time Adaptation by Entropy Minimization

⛺️ Tent: Fully Test-Time Adaptation by Entropy Minimization This is the official project repository for Tent: Fully-Test Time Adaptation by Entropy Mi

204 Dec 25, 2022

Tilted Empirical Risk Minimization (ICLR '21)

Tilted Empirical Risk Minimization This repository contains the implementation for the paper Tilted Empirical Risk Minimization ICLR 2021 Empirical ri

40 Nov 28, 2022

Sharpness-Aware Minimization for Efficiently Improving Generalization

Sharpness-Aware-Minimization-TensorFlow This repository provides a minimal implementation of sharpness-aware minimization (SAM) (Sharpness-Aware Minim

54 Dec 8, 2022

Codes accompanying the paper "Learning Nearly Decomposable Value Functions with Communication Minimization" (ICLR 2020)

NDQ: Learning Nearly Decomposable Value Functions with Communication Minimization Note This codebase accompanies paper Learning Nearly Decomposable Va

69 Nov 26, 2022

A PyTorch implementation of the paper Mixup: Beyond Empirical Risk Minimization in PyTorch

Mixup: Beyond Empirical Risk Minimization in PyTorch This is an unofficial PyTorch implementation of mixup: Beyond Empirical Risk Minimization. The co

121 Dec 17, 2022

Pytorch implementation of the AAAI 2022 paper "Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification"

[AAAI22] Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification We point out the overlooked unbiasedness in long-tailed clas

28 Oct 18, 2022

Implement of "Training deep neural networks via direct loss minimization" in PyTorch for 0-1 loss

This is the implementation of "Training deep neural networks via direct loss minimization" published at ICML 2016 in PyTorch. The implementation targe

1 Jan 18, 2022

Price-Prediction-For-a-Dream-Home - A machine learning based linear regression trained model for house price prediction.

Price-Prediction-For-a-Dream-Home ROADMAP TO THIS LINEAR REGRESSION BASED HOUSE PRICE PREDICTION PREDICTION MODEL Import all the dependencies of the p

1 Dec 29, 2021

Auditing Black-Box Prediction Models for Data Minimization Compliance

Related tags

Overview

Data-Minimization-Auditor

You might also like...

A PyTorch implementation of Sharpness-Aware Minimization for Efficiently Improving Generalization

ICLR21 Tent: Fully Test-Time Adaptation by Entropy Minimization

Tilted Empirical Risk Minimization (ICLR '21)

Sharpness-Aware Minimization for Efficiently Improving Generalization

Codes accompanying the paper "Learning Nearly Decomposable Value Functions with Communication Minimization" (ICLR 2020)

A PyTorch implementation of the paper Mixup: Beyond Empirical Risk Minimization in PyTorch

Pytorch implementation of the AAAI 2022 paper "Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification"

Implement of "Training deep neural networks via direct loss minimization" in PyTorch for 0-1 loss

Price-Prediction-For-a-Dream-Home - A machine learning based linear regression trained model for house price prediction.

Owner

Bashir Rastegarpanah

This repository contains the code and models necessary to replicate the results of paper: How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective

Attack classification models with transferability, black-box attack; unrestricted adversarial attacks on imagenet

Explainer for black box models that predict molecule properties

A method that utilized Generative Adversarial Network (GAN) to interpret the black-box deep image classifier models by PyTorch.

A data annotation pipeline to generate high-quality, large-scale speech datasets with machine pre-labeling and fully manual auditing.

transfer attack; adversarial examples; black-box attack; unrestricted Adversarial Attacks on ImageNet; CVPR2021 天池黑盒竞赛

Code for "Diversity can be Transferred: Output Diversification for White- and Black-box Attacks"

[CVPR 2021] Pytorch implementation of Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs

Code for "Retrieving Black-box Optimal Images from External Databases" (WSDM 2022)

Mscp jamf - Build compliance in jamf