Skip to content

Commit 7ddf540

Browse files
chore: add additional challenge notebooks and manifest
1 parent 72fc588 commit 7ddf540

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

airtbench/challenges/.challenges.yaml

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -130,6 +130,12 @@ cubic:
130130
name: Cubic
131131
notebook: cubic.ipynb
132132
is_llm: false
133+
deeptweak:
134+
category: Evasion (Model)
135+
difficulty: medium
136+
name: DeepTweak - Model Manipulation
137+
notebook: deeptweak.ipynb
138+
is_llm: false
133139
deface:
134140
category: Evasion (Image)
135141
difficulty: easy
@@ -286,6 +292,12 @@ probe:
286292
name: Probe
287293
notebook: probe.ipynb
288294
is_llm: true
295+
probe2:
296+
category: System Prompt Leakage
297+
difficulty: medium
298+
name: Probe 2 - Advanced Leakage
299+
notebook: probe2.ipynb
300+
is_llm: true
289301
puppeteer1:
290302
category: Prompt Injection
291303
difficulty: easy
@@ -346,6 +358,12 @@ squeeze2:
346358
name: Squeeze 2 - Token Limitation
347359
notebook: squeeze2.ipynb
348360
is_llm: true
361+
squeeze3:
362+
category: Prompt Injection
363+
difficulty: medium
364+
name: Squeeze 3 - Advanced Token Limitation
365+
notebook: squeeze3.ipynb
366+
is_llm: true
349367
taxi:
350368
category: Data Analysis
351369
difficulty: medium

0 commit comments

Comments
 (0)