Skip to content

Quickstart

Runs in well under a second on a CPU — no GPU, no model download.

pip install provael
provael attack --recipe full-sweep --out runs/first-scan
                        Provael — ASR by attack
┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━┓
┃ attack            ┃ EAI   ┃              ASR ┃ successes ┃ attempts ┃
┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━┩
│ freeze            │ EAI04 │ 100.0% [72–100%] │        10 │       10 │
│ patch             │ EAI02 │   80.0% [49–94%] │         8 │       10 │
│ roleplay          │ EAI01 │   80.0% [49–94%] │         8 │       10 │
│ …                 │ …     │              …   │         … │        … │
└───────────────────┴───────┴──────────────────┴───────────┴──────────┘
Attack Success Rate (ASR): 74.4% (67/90)

Commands

provael list-policies         # 7 policies (stub CPU; smolvla/pi0/groot/openvla need extras)
provael list-attacks          # 9 attacks across instruction/visual/injection/action
provael list-recipes          # named presets: quick / instruction-only / full-sweep / ci-gate
provael list-reproductions    # FreezeVLA / OpenVLA-patch / BadVLA / RoboPAIR
provael reproduce freezevla   # reproduce a published attack on the CPU stub
provael report --in runs/first-scan --format scorecard   # one-page ASR scorecard
provael report --in runs/first-scan --format oscal       # NIST OSCAL evidence
provael export --in runs/first-scan --format avid        # AVID record

Outputs

report.json (byte-deterministic), report.md, SARIF (--format sarif), a compliance evidence pack (--format compliance), an ASR scorecard (--format scorecard), OSCAL, and an AVID record.

Real models & simulators

pip install 'provael[lerobot]'                 # GPU
PROVAEL_INTEGRATION=1 provael attack --policy smolvla --suite libero \
    --model HuggingFaceVLA/smolvla_libero --attacks none,instruction,visual,injection

See the examples gallery for π0 / GR00T / OpenVLA adapters and the second (Meta-World) suite.