7 attack vs defense

.dockerignore

@@ -1,5 +1,4 @@
 venv
-output
-bin
-__pycache__
-.pytest_cache
+**/output
+**/__pycache__
+**/.pytest_cache

.github/workflows/pylint.yml

@@ -19,7 +19,6 @@ jobs:
       run: |
         python -m pip install --upgrade pip
         pip install pylint
-        if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
-    - name: Analysing the code with pylint
+    - name: Analyzing code with pylint
       run: |
         pylint $(git ls-files '*.py')

.github/workflows/python-app.yml

@@ -17,6 +17,8 @@ jobs:
         python-version: ${{ matrix.python-version }}
     - name: Install dependencies
       run: |
+        sudo apt-get update
+        sudo apt-get install -y build-essential swig libglpk-dev python3-dev libcdd-dev libgmp-dev
         python -m pip install --upgrade pip
         pip install flake8 pytest pytest-cov
         if [ -f requirements.txt ]; then pip install -r requirements.txt; fi

.gitignore

@@ -1,5 +1,9 @@
 venv
-output
+output*
+bns
+data
+plots
+*meta.txt
 bin
 __pycache__
 .pytest_cache

Dockerfile

@@ -1,8 +1,20 @@
-FROM python:bookworm
+FROM python:3.12-slim
 
+# Install system dependencies
+RUN apt-get update && apt-get install -y \
+    build-essential \
+    swig \ 
+    libglpk-dev \
+    python3-dev \ 
+    libcdd-dev \ 
+    libgmp-dev \
+    && rm -rf /var/lib/apt/lists/*
+
+# Set working directory
 WORKDIR /workspace
 COPY . .
 
+# Install python packages
 RUN pip install --upgrade pip
 RUN if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
 

README.md

@@ -2,104 +2,144 @@
 
 Code for paper ["Towards Privacy-Aware Bayesian Networks: A Credal Approach"](https://doi.org/10.3233/FAIA251419) presented at [ECAI 2025](https://ecai2025.org/).
 
-## Set up Python environment
+## Preliminaries
 
-Create and activate a Python virtual environment with: 
+### Experiments
 
-```bash
-python3 -m venv venv
-source venv/bin/activate[.fish]  # use `.fish` suffix if using fish shell
-```
+`<name>` is the name of the experiment to run. Each `<name>` has its own directory, which is named the same way. Each of these contains the experiment logic, configuration file (`config.yaml`), eventually generated models and data, output directory, and a `Plot_results.ipynb` notebook to plot results.
 
-Install all dependencies with: 
+`<name>` can be one of the following:
 
-```bash
-pip install -r requirements.txt
-```
+1. `cn_privacy`: run membership inference attack against a Bayesian network (BN), its related credal network (CN), and compute the theoretical privacy estimate of BN.
 
-Upgrade all Python packages with: 
+2. `cn_vs_noisybn`: compare two privacy techniques, namely the CN and a noisy version of BN. All models are naive Bayes with target variable T. First, the CN and noisy BN hyperparameters are fine-tuned so that they achieve the same privacy level; then, their accuracy is computed in terms of most probable explanation (MPE) on variable T.
 
-```bash
-pip install --upgrade $(pip freeze | cut -d '=' -f 1)
-pip freeze > requirements.txt
-```
+For additional details, we refer to the paper.
 
-This updates the requirements file with the upgraded packages.
+### Attacks and defenses
 
-## Experiments
+Each experiment requires the user to specify one defense and one attack mechanisms, plus additional related hyperparameters. Below, the mechanisms and hyperparameters names are reported.
 
-`<name>` is the name of the experiment to run. It can be one of the following.
+Implemented defenses:
+- `def_idm`. Requires: `ess`.
+- `def_ran`. Requires: `delta`.
 
-1. `cn_privacy`: run membership inference attack against a Bayesian network (BN), its related credal network (CN), and compute the theoretical privacy estimate of BN. The pipeline and results are described in the paper.
+Implemented attacks:
+- `atk_mle`. Requires: `n_bns`.
+- `atk_cen`.
+- `atk_ran`.
+- `atk_ent`.
 
-2. `cn_vs_noisybn`: additional experiment, not reported in the paper. It compares two privacy techniques, namely the CN and a noisy version of BN. All models are naive Bayes with target variable T. First, the CN and noisy BN hyperparameters are fine-tuned so that they achieve the same privacy level; then, their accuracy is computed in terms of most probable explanation (MPE) on variable T.
+## Running code
 
-## Run code
+### Using Docker (recommended)
 
-### With Docker (recommended)
+The `compose.yaml` file contains a set of pre-set experiments. Additional ones can also be specified. The `generate_compose.py` file helps in generating them automatically.
 
-1. Build the Docker image:
+Generate models and data for all experiments (controlled by `config.yaml`):
 
-```bash
-docker build . -t bnp:2025
+```sh
+python -m experiments.cn_privacy.generate
+python -m experiments.cn_vs_noisybn.generate
 ```
 
-2. Run the experiment:
+Run one or more experiments with:
 
-```bash
-docker run [-d] [--rm] -v bnp:/workspace bnp:2025 python -m experiments.<name>.main
+```sh
+docker compose up [service name]
 ```
 
-3. Results available at: 
+Results will be available under `experiments/<name>/output_*`.
 
-`/var/lib/docker/volumes/bnp/_data/experiments/<name>/output/`.
+To check the status, run one or more of the following:
 
-### Without Docker
+```sh
+docker compose ps
+docker compose logs [service name]
+docker stats
+```
 
-1. Run the experiment: 
+### Local computation
 
-```bash
-python -m experiments.<name>.main
+Create and activate a Python virtual environment: 
+
+```sh
+python3 -m venv venv
+source venv/bin/activate[.fish]  # use `.fish` suffix if using fish shell
 ```
 
-2. Results available at: 
+Install dependencies: 
 
-`experiments/<name>/output/`.
+```sh
+pip install -r requirements.txt
+```
 
-## Test code
+*Notice*: if some package is missing locally, see the `Dockerfile` for additional packages to be installed (names refer to Ubuntu/Debian).
 
-Run tests with:
+Upgrade dependencies: 
 
-```bash
-pytest [--cov=src] [--cov-report=term-missing] [--capture=no]
+```sh
+pip install --upgrade $(pip freeze | cut -d '=' -f 1)
+pip freeze > requirements.txt
 ```
 
-Test results are available at: 
+*Notice:* each of the following command will overwrite any related output. 
 
-`test/<name>/output/`.
+Generate models and data (controlled by `config.yaml`):
+
+```sh
+python -m experiments.<name>.generate
+```
+
+Run an experiment: 
+
+```sh
+python -m experiments.<name>.exp def_mec=<def_name> [param=value] atk_mec=<def_name> [param=value]
+```
+
+Results will be available under `experiments/<name>/output`.
+
+
+## Testing code
+
+Run integration tests:
+
+```sh
+pytest [--cov=src] [--cov-report=term-missing] [--capture=no]
+```
 
 ## Formatting and linting
 
 Format code by running:
 
-```bash
+```sh
 black .
 isort .
 ```
 
 Lint code by running:
 
-```bash
+```sh
 flake8 . --count --select=E9,F63,F7,F82 --show-source --statistics --exclude=venv
-flake8 . --count --exit-zero --max-complexity=10 --max-line-length=127 --statistics --exclude=venv
+flake8 . --count --exit-zero --max-complexity=10 --ignore=E203 --max-line-length=140 --statistics --exclude=venv
 ```
 
 Analyze code by running:
 
-```bash
+```sh
 pylint $(git ls-files '*.py')
 ```
 
-## Plot results
+## Running actions locally
+
+Install `act`:
+
+```sh
+curl --proto '=https' --tlsv1.2 -sSf https://raw.githubusercontent.com/nektos/act/master/install.sh | sudo bash
+```
+
+Run `act` with: 
 
-Use the `Plot_results.ipynb` notebook available for each experiment. Plots will be saved at: `experiments/<name>/output/plots`.
+```sh
+sudo ./bin/act [-W <path_to_file>]
+```

compose.yaml

@@ -0,0 +1,86 @@
+version: '3.9'
+services:
+  cn_vs_noisybn_def_idm_atk_ran_ess1:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_idm
+    - atk_mec=atk_ran
+    - ess=1
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_idm_atk_ran_ess1:/workspace/experiments/cn_vs_noisybn/output
+  cn_vs_noisybn_def_idm_atk_ran_ess100:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_idm
+    - atk_mec=atk_ran
+    - ess=100
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_idm_atk_ran_ess100:/workspace/experiments/cn_vs_noisybn/output
+  cn_vs_noisybn_def_idm_atk_ran_ess50:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_idm
+    - atk_mec=atk_ran
+    - ess=50
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_idm_atk_ran_ess50:/workspace/experiments/cn_vs_noisybn/output
+  cn_vs_noisybn_def_ran_atk_ran_delta0.001:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_ran
+    - atk_mec=atk_ran
+    - delta=0.001
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_ran_atk_ran_delta0.001:/workspace/experiments/cn_vs_noisybn/output
+  cn_vs_noisybn_def_ran_atk_ran_delta0.05:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_ran
+    - atk_mec=atk_ran
+    - delta=0.05
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_ran_atk_ran_delta0.05:/workspace/experiments/cn_vs_noisybn/output
+  cn_vs_noisybn_def_ran_atk_ran_delta0.1:
+    build: .
+    command:
+    - python
+    - -m
+    - experiments.cn_vs_noisybn.exp
+    - def_mec=def_ran
+    - atk_mec=atk_ran
+    - delta=0.1
+    image: bnp:2025
+    volumes:
+    - ./experiments/cn_vs_noisybn/bns:/workspace/experiments/cn_vs_noisybn/bns
+    - ./experiments/cn_vs_noisybn/data:/workspace/experiments/cn_vs_noisybn/data
+    - ./experiments/cn_vs_noisybn/output_def_ran_atk_ran_delta0.1:/workspace/experiments/cn_vs_noisybn/output