• Level 0: No Knowledge Needed — AI fully deobfuscates without assistance.
• Level 1: Basic Guidance — Minimal hints to correct minor errors.
• Level 2: Structural Correction — Significant guidance needed for structural issues.
• Level 3: Major Intervention — Detailed guidance necessary to resolve complex logic errors.
• Level 4: Expert Rework — Extensive expert intervention required.
• Level 5: Beyond Expert Correction — Errors too fundamental, requiring a complete restart.
• No Level(-): Unable to Analyze — AI produced no meaningful output.
Fonte: Ref 1
🤞
Fonte: AWS
https://openreview.net/pdf?id=WE_vluYUL-X
https://arxiv.org/pdf/2409.16165
https://proceedings.neurips.cc/paper_files/paper/2024/file/69d97a6493fbf016fff0a751f253ad18-Paper-Datasets_and_Benchmarks_Track.pdf
https://atlas.mitre.org/matrices/ATLAS
https://github.com/NVIDIA-NeMo/Guardrails
https://github.com/dreadnode/rigging
https://github.com/nyu-llm-ctf/nyuctf_agents
https://github.com/enigma-agent/trajectories
https://github.com/lauriewired/ghidramcp