sumitaidev commited on
Commit
1803fb2
·
verified ·
1 Parent(s): a021cf1

Deploy Adaptive Agent Memory Resilience Research Playground

Browse files
README.md CHANGED
@@ -1,10 +1,33 @@
1
  ---
2
- title: Adaptive Agent Memory Playground
3
- emoji: 🐨
4
- colorFrom: green
5
- colorTo: green
6
  sdk: static
7
- pinned: false
 
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Adaptive Agent Memory Resilience Playground
3
+ colorFrom: indigo
4
+ colorTo: blue
 
5
  sdk: static
6
+ pinned: true
7
+ license: apache-2.0
8
+ short_description: Bayesian Trust Engine & Pessimistic LCB Retrieval
9
  ---
10
 
11
+ # Adaptive Agent Memory Resilience Playground
12
+
13
+ An interactive research playground demonstrating mathematical trust dynamics and pessimistic memory retrieval for autonomous LLM agents (LangGraph, AutoGen, CrewAI).
14
+
15
+ This Space accompanies the research paper:
16
+ **"Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval"** by Sumit Das (2026).
17
+
18
+ ## Live Demonstrations
19
+ 1. **Bayesian Reliability & Statistical Quarantine**:
20
+ - Conjugate Beta-Bernoulli updating ($\alpha_0=3.0, \beta_0=1.0$).
21
+ - Dynamic epistemic uncertainty estimation ($\sigma = \sqrt{\operatorname{Var}[\theta]}$).
22
+ - Incomplete Beta integral for reliability threshold $\mathbb{P}(\theta > 0.70)$.
23
+ - Theorem 1 deterministic quarantine trigger at $t^* = 4$ consecutive failures.
24
+ 2. **Pessimistic LCB Memory Retriever**:
25
+ - Compare unweighted Cosine Similarity against the proposed composite Lower Confidence Bound ($\operatorname{LCB}_\lambda$) ranking:
26
+ $\operatorname{Score}(e; q) = \operatorname{Sim}(\mathbf{q}, \mathbf{v}_e) \times \operatorname{LCB}_\lambda(e)$
27
+ - Demonstrates suppression of corrupted high-similarity strategies under adversarial drift.
28
+ 3. **Empirical Benchmark Explorer**:
29
+ - Live inspection of 1,200 execution traces and 100 experiential memories comparing 4 experimental ablation conditions.
30
+
31
+ ## Dataset Reference
32
+ The full benchmark dataset is available at:
33
+ `sumitaidev/agent-memory-resilience-benchmark`
__pycache__/app.cpython-313.pyc ADDED
Binary file (23.2 kB). View file
 
app.py ADDED
@@ -0,0 +1,476 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """
2
+ Adaptive Agent Memory Resilience: Interactive Research Playground
3
+ Author: Sumit Das (arXiv Pre-print 2026)
4
+ Demonstrates Bayesian Trust Updating, Pessimistic Lower Confidence Bound (LCB) Retrieval,
5
+ and Theorem 1 Statistical Quarantine for Autonomous LLM Agents.
6
+ Strict compliance: Zero emojis, rigorous mathematical formulas, typed logic.
7
+ """
8
+
9
+ import math
10
+ from pathlib import Path
11
+ from typing import Dict, List, Tuple
12
+
13
+ import gradio as gr
14
+ import numpy as np
15
+ import pandas as pd
16
+ import plotly.graph_objects as go
17
+ import scipy.special as sc
18
+ import scipy.stats as stats
19
+
20
+ # --- Mathematical Engine (Conjugate Beta-Bernoulli & Theorem 1) ---
21
+
22
+ def beta_trust_mean(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
23
+ alpha_post = alpha_0 + float(successes)
24
+ beta_post = beta_0 + float(failures)
25
+ return float(alpha_post / (alpha_post + beta_post))
26
+
27
+
28
+ def beta_trust_var(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
29
+ alpha_post = alpha_0 + float(successes)
30
+ beta_post = beta_0 + float(failures)
31
+ total = alpha_post + beta_post
32
+ return float((alpha_post * beta_post) / ((total ** 2) * (total + 1.0)))
33
+
34
+
35
+ def beta_trust_std(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
36
+ return float(math.sqrt(beta_trust_var(successes, failures, alpha_0, beta_0)))
37
+
38
+
39
+ def beta_lcb(
40
+ successes: int,
41
+ failures: int,
42
+ lambda_risk: float = 1.0,
43
+ alpha_0: float = 3.0,
44
+ beta_0: float = 1.0,
45
+ ) -> float:
46
+ mu = beta_trust_mean(successes, failures, alpha_0, beta_0)
47
+ sigma = beta_trust_std(successes, failures, alpha_0, beta_0)
48
+ score = mu - (lambda_risk * sigma)
49
+ return float(max(0.0, min(1.0, score)))
50
+
51
+
52
+ def posterior_probability_reliable(
53
+ successes: int,
54
+ failures: int,
55
+ threshold: float = 0.70,
56
+ alpha_0: float = 3.0,
57
+ beta_0: float = 1.0,
58
+ ) -> float:
59
+ alpha_post = alpha_0 + float(successes)
60
+ beta_post = beta_0 + float(failures)
61
+ cdf_at_thresh = float(sc.betainc(alpha_post, beta_post, threshold))
62
+ return float(max(0.0, min(1.0, 1.0 - cdf_at_thresh)))
63
+
64
+
65
+ def should_quarantine(
66
+ successes: int,
67
+ failures: int,
68
+ gamma: float = 0.05,
69
+ threshold: float = 0.70,
70
+ alpha_0: float = 3.0,
71
+ beta_0: float = 1.0,
72
+ ) -> bool:
73
+ prob = posterior_probability_reliable(successes, failures, threshold, alpha_0, beta_0)
74
+ return prob < gamma
75
+
76
+
77
+ def compute_consecutive_failure_series(
78
+ alpha_0: float = 3.0,
79
+ beta_0: float = 1.0,
80
+ gamma: float = 0.05,
81
+ threshold: float = 0.70,
82
+ max_steps: int = 6,
83
+ ) -> pd.DataFrame:
84
+ rows = []
85
+ for t in range(0, max_steps + 1):
86
+ alpha_post = alpha_0
87
+ beta_post = beta_0 + float(t)
88
+ mu = alpha_post / (alpha_post + beta_post)
89
+ std = math.sqrt((alpha_post * beta_post) / (((alpha_post + beta_post) ** 2) * (alpha_post + beta_post + 1.0)))
90
+ p_rel = posterior_probability_reliable(0, t, threshold, alpha_0, beta_0)
91
+ is_q = p_rel < gamma
92
+ status = "QUARANTINED (Threshold Triggered)" if is_q else "ACTIVE (Admissible)"
93
+ rows.append({
94
+ "Consecutive Failures (t)": t,
95
+ "Posterior Beta": f"Beta({alpha_post:.1f}, {beta_post:.1f})",
96
+ "Posterior Mean E[theta]": f"{mu:.4f}",
97
+ "Uncertainty (sigma)": f"{std:.4f}",
98
+ "P(theta > 0.70)": f"{p_rel * 100:.2f}%",
99
+ "Quarantine Status": status,
100
+ })
101
+ return pd.DataFrame(rows)
102
+
103
+
104
+ # --- Visualizers ---
105
+
106
+ def plot_beta_posterior(
107
+ alpha_0: float,
108
+ beta_0: float,
109
+ successes: int,
110
+ failures: int,
111
+ lambda_risk: float,
112
+ threshold: float,
113
+ gamma: float,
114
+ ) -> Tuple[go.Figure, str, str, str, str, str]:
115
+ alpha_post = alpha_0 + float(successes)
116
+ beta_post = beta_0 + float(failures)
117
+ mu = beta_trust_mean(successes, failures, alpha_0, beta_0)
118
+ std = beta_trust_std(successes, failures, alpha_0, beta_0)
119
+ lcb_val = beta_lcb(successes, failures, lambda_risk, alpha_0, beta_0)
120
+ p_rel = posterior_probability_reliable(successes, failures, threshold, alpha_0, beta_0)
121
+ is_quarantined = p_rel < gamma
122
+
123
+ x = np.linspace(0.001, 0.999, 600)
124
+ y = stats.beta.pdf(x, alpha_post, beta_post)
125
+
126
+ fig = go.Figure()
127
+
128
+ # Prior curve for visual comparison
129
+ y_prior = stats.beta.pdf(x, alpha_0, beta_0)
130
+ fig.add_trace(go.Scatter(
131
+ x=x,
132
+ y=y_prior,
133
+ mode="lines",
134
+ line=dict(color="rgba(140, 140, 140, 0.6)", width=1.5, dash="dash"),
135
+ name=f"Prior Beta({alpha_0:.1f}, {beta_0:.1f})",
136
+ ))
137
+
138
+ # Posterior curve
139
+ fig.add_trace(go.Scatter(
140
+ x=x,
141
+ y=y,
142
+ mode="lines",
143
+ line=dict(color="#2563eb", width=3),
144
+ name=f"Posterior Beta({alpha_post:.1f}, {beta_post:.1f})",
145
+ ))
146
+
147
+ # Shading for Reliable region (theta >= threshold)
148
+ x_rel = x[x >= threshold]
149
+ y_rel = y[x >= threshold]
150
+ if len(x_rel) > 0:
151
+ fig.add_trace(go.Scatter(
152
+ x=np.concatenate([[threshold], x_rel, [x_rel[-1]]]),
153
+ y=np.concatenate([[0], y_rel, [0]]),
154
+ fill="toself",
155
+ fillcolor="rgba(34, 197, 94, 0.25)",
156
+ line=dict(color="rgba(255,255,255,0)"),
157
+ name=f"Admissible Region (P={p_rel*100:.1f}%)",
158
+ hoverinfo="skip",
159
+ ))
160
+
161
+ # Vertical reference lines
162
+ max_y = float(np.max(y)) * 1.05 if np.max(y) > 0 else 5.0
163
+
164
+ # Operational threshold line
165
+ fig.add_vline(
166
+ x=threshold,
167
+ line=dict(color="#ef4444", width=2, dash="dash"),
168
+ annotation_text=f"Admissibility Threshold ({threshold:.2f})",
169
+ annotation_position="top left",
170
+ )
171
+
172
+ # Posterior mean line
173
+ fig.add_vline(
174
+ x=mu,
175
+ line=dict(color="#2563eb", width=2),
176
+ annotation_text=f"Mean E[theta]={mu:.3f}",
177
+ annotation_position="top right",
178
+ )
179
+
180
+ # LCB line
181
+ fig.add_vline(
182
+ x=lcb_val,
183
+ line=dict(color="#8b5cf6", width=2, dash="dot"),
184
+ annotation_text=f"LCB(lambda={lambda_risk:.1f})={lcb_val:.3f}",
185
+ annotation_position="bottom left",
186
+ )
187
+
188
+ fig.update_layout(
189
+ title=dict(
190
+ text=f"Posterior Reliability Distribution: Beta({alpha_post:.1f}, {beta_post:.1f}) vs Prior Beta({alpha_0:.1f}, {beta_0:.1f})",
191
+ font=dict(size=15),
192
+ ),
193
+ xaxis=dict(title="True Latent Reliability theta in [0, 1]", range=[0.0, 1.0], gridcolor="#e5e7eb"),
194
+ yaxis=dict(title="Probability Density f(theta)", range=[0.0, max_y], gridcolor="#e5e7eb"),
195
+ template="plotly_white",
196
+ margin=dict(l=40, r=40, t=50, b=40),
197
+ legend=dict(orientation="h", yanchor="bottom", y=1.02, xanchor="right", x=1.0),
198
+ )
199
+
200
+ status_str = "QUARANTINED (Pruned from Retrieval)" if is_quarantined else "ACTIVE (Admissible for Retrieval)"
201
+ status_bg = "#fee2e2" if is_quarantined else "#dcfce7"
202
+ status_text_color = "#991b1b" if is_quarantined else "#166534"
203
+ status_card = (
204
+ f"<div style='padding: 12px 18px; border-radius: 8px; background-color: {status_bg}; "
205
+ f"color: {status_text_color}; font-weight: 600; font-size: 16px; border: 1px solid {status_text_color};'>"
206
+ f"Operational Status: {status_str}</div>"
207
+ )
208
+
209
+ metric_mean = f"{mu:.4f}"
210
+ metric_sigma = f"{std:.4f}"
211
+ metric_lcb = f"{lcb_val:.4f}"
212
+ metric_prob = f"{p_rel * 100:.2f}%"
213
+
214
+ return fig, status_card, metric_mean, metric_sigma, metric_lcb, metric_prob
215
+
216
+
217
+ # --- Retrieval Simulation Data ---
218
+
219
+ SAMPLE_MEMORIES = [
220
+ {
221
+ "id": "MEM-CORRUPT-01",
222
+ "domain": "coding",
223
+ "lesson": "Use global shared state across async workers without mutex lock for throughput.",
224
+ "cosine_sim": 0.94,
225
+ "successes": 2,
226
+ "failures": 5,
227
+ "note": "Corrupted/stale reflection causing race condition deadlocks.",
228
+ },
229
+ {
230
+ "id": "MEM-ROBUST-02",
231
+ "domain": "coding",
232
+ "lesson": "Implement asyncio.Lock with timeout fallback and circuit breaker isolation.",
233
+ "cosine_sim": 0.83,
234
+ "successes": 22,
235
+ "failures": 1,
236
+ "note": "High empirical validation under stress tests.",
237
+ },
238
+ {
239
+ "id": "MEM-UNTESTED-03",
240
+ "domain": "coding",
241
+ "lesson": "Refactor threading pool to use separate child process queues.",
242
+ "cosine_sim": 0.89,
243
+ "successes": 0,
244
+ "failures": 0,
245
+ "note": "Newly distilled reflection with zero empirical execution history.",
246
+ },
247
+ {
248
+ "id": "MEM-MARGINAL-04",
249
+ "domain": "coding",
250
+ "lesson": "Log execution traceback to local scratch buffer before propagating exceptions.",
251
+ "cosine_sim": 0.65,
252
+ "successes": 15,
253
+ "failures": 2,
254
+ "note": "Low direct task relevance, but high historical reliability.",
255
+ },
256
+ ]
257
+
258
+
259
+ def evaluate_retrieval_ranking(lambda_risk: float, alpha_0: float = 3.0, beta_0: float = 1.0) -> pd.DataFrame:
260
+ rows = []
261
+ for m in SAMPLE_MEMORIES:
262
+ ns = m["successes"]
263
+ nf = m["failures"]
264
+ sim = m["cosine_sim"]
265
+ mu = beta_trust_mean(ns, nf, alpha_0, beta_0)
266
+ std = beta_trust_std(ns, nf, alpha_0, beta_0)
267
+ lcb_score = beta_lcb(ns, nf, lambda_risk, alpha_0, beta_0)
268
+ p_rel = posterior_probability_reliable(ns, nf, 0.70, alpha_0, beta_0)
269
+ is_q = should_quarantine(ns, nf, 0.05, 0.70, alpha_0, beta_0)
270
+
271
+ naive_score = sim
272
+ composite_score = 0.0 if is_q else sim * lcb_score
273
+
274
+ rows.append({
275
+ "Memory ID": m["id"],
276
+ "Cosine Sim": sim,
277
+ "Successes (ns)": ns,
278
+ "Failures (nf)": nf,
279
+ "Posterior Mean E[theta]": round(mu, 3),
280
+ "Uncertainty (sigma)": round(std, 3),
281
+ "LCB Score": round(lcb_score, 3),
282
+ "Naive Retrieval Score": round(naive_score, 3),
283
+ "Pessimistic LCB Composite": round(composite_score, 3),
284
+ "Quarantine": "QUARANTINED" if is_q else "ACTIVE",
285
+ "Strategy Directives": m["lesson"],
286
+ })
287
+
288
+ df = pd.DataFrame(rows)
289
+ # Sort primarily by proposed composite score descending
290
+ df = df.sort_values(by="Pessimistic LCB Composite", ascending=False).reset_index(drop=True)
291
+ df.insert(0, "LCB Rank", [f"#{i+1}" for i in range(len(df))])
292
+ return df
293
+
294
+
295
+ # --- Load Real Benchmark Data for Explorer ---
296
+
297
+ DATA_DIR = Path(__file__).parent / "data"
298
+
299
+ def load_benchmark_summary() -> Tuple[pd.DataFrame, pd.DataFrame]:
300
+ traces_path = DATA_DIR / "telemetry_traces.csv"
301
+ mem_path = DATA_DIR / "memory_bank_experiences.csv"
302
+
303
+ if traces_path.exists():
304
+ df_traces = pd.read_csv(traces_path)
305
+ summary = (
306
+ df_traces.groupby("ablation_condition")
307
+ .agg(
308
+ Total_Steps=("step_index", "count"),
309
+ Accuracy=("task_success", "mean"),
310
+ Avg_Reward=("observed_reward", "mean"),
311
+ Mean_Similarity=("cosine_similarity", "mean"),
312
+ Quarantine_Triggers=("quarantine_triggered", "sum"),
313
+ )
314
+ .reset_index()
315
+ )
316
+ summary["Accuracy"] = summary["Accuracy"].apply(lambda v: f"{v * 100:.2f}%")
317
+ summary["Avg_Reward"] = summary["Avg_Reward"].apply(lambda v: f"{v:.3f}")
318
+ summary["Mean_Similarity"] = summary["Mean_Similarity"].apply(lambda v: f"{v:.3f}")
319
+ else:
320
+ summary = pd.DataFrame({"Notice": ["telemetry_traces.csv not found locally."]})
321
+
322
+ if mem_path.exists():
323
+ df_mem = pd.read_csv(mem_path)
324
+ mem_preview = df_mem[[
325
+ "experience_id", "task_domain", "successes_count", "failures_count",
326
+ "posterior_mean_trust", "posterior_variance", "pessimistic_lcb_score",
327
+ "quarantine_status", "is_adversarial_sample"
328
+ ]].head(25)
329
+ else:
330
+ mem_preview = pd.DataFrame({"Notice": ["memory_bank_experiences.csv not found locally."]})
331
+
332
+ return summary, mem_preview
333
+
334
+
335
+ # --- Gradio Application Layout ---
336
+
337
+ def build_app() -> gr.Blocks:
338
+ theme = gr.themes.Soft(
339
+ primary_hue="blue",
340
+ neutral_hue="slate",
341
+ )
342
+
343
+ with gr.Blocks(title="Adaptive Agent Memory Resilience Playground") as demo:
344
+ gr.Markdown(
345
+ """
346
+ # Adaptive Agent Memory Resilience Playground
347
+ ### Mathematical Trust Dynamics & Pessimistic LCB Memory Retrieval for Autonomous LLM Agents
348
+ **Author:** Sumit Das (`@sumitaidev`) | Research Paper Pre-print (2026) | [Benchmark Dataset](https://huggingface.co/datasets/sumitaidev/agent-memory-resilience-benchmark)
349
+
350
+ This research tool allows AI researchers and engineers to interactively analyze how Bayesian conjugate updating,
351
+ epistemic variance quantification, and pessimistic Lower Confidence Bound (LCB) composite retrieval prevent
352
+ **Negative Transfer** and **Memory Poisoning** in agent systems (such as LangGraph, AutoGen, and CrewAI).
353
+ """
354
+ )
355
+
356
+ with gr.Tabs():
357
+ # TAB 1: Bayesian Reliability & Quarantine Engine
358
+ with gr.TabItem("1. Bayesian Reliability & Theorem 1"):
359
+ gr.Markdown(
360
+ """
361
+ ### Conjugate Beta-Bernoulli Posterior Update Engine
362
+ Simulates task trials for an individual experiential memory record under weakly-informative prior $\\operatorname{Beta}(\\alpha_0=3.0, \\beta_0=1.0)$.
363
+ Theorem 1 states that at operational threshold $\\theta=0.70$ and significance $\\gamma=0.05$, exactly $t^* = 4$ consecutive failures triggers deterministic quarantine.
364
+ """
365
+ )
366
+ with gr.Row():
367
+ with gr.Column(scale=1):
368
+ alpha_0_input = gr.Slider(0.5, 10.0, value=3.0, step=0.5, label="Prior Alpha (alpha_0)")
369
+ beta_0_input = gr.Slider(0.5, 10.0, value=1.0, step=0.5, label="Prior Beta (beta_0)")
370
+ successes_input = gr.Slider(0, 50, value=0, step=1, label="Observed Task Successes (n_s)")
371
+ failures_input = gr.Slider(0, 20, value=0, step=1, label="Observed Task Failures (n_f)")
372
+ lambda_input = gr.Slider(0.0, 3.0, value=1.0, step=0.2, label="Risk Aversion Parameter (lambda)")
373
+ threshold_input = gr.Slider(0.5, 0.9, value=0.70, step=0.05, label="Admissibility Standard (threshold)")
374
+ gamma_input = gr.Slider(0.01, 0.20, value=0.05, step=0.01, label="Quarantine Significance Level (gamma)")
375
+
376
+ status_html = gr.HTML()
377
+
378
+ with gr.Column(scale=2):
379
+ with gr.Row():
380
+ mean_kpi = gr.Textbox(label="Posterior Mean E[theta]", interactive=False)
381
+ sigma_kpi = gr.Textbox(label="Uncertainty (sigma)", interactive=False)
382
+ lcb_kpi = gr.Textbox(label="LCB Score", interactive=False)
383
+ prob_kpi = gr.Textbox(label="P(theta > threshold)", interactive=False)
384
+
385
+ plot_output = gr.Plot(label="Posterior Reliability Distribution")
386
+
387
+ gr.Markdown("#### Theorem 1 Deterministic Verification: Consecutive Failure Trajectory")
388
+ theorem_table = gr.Dataframe(
389
+ headers=["Consecutive Failures (t)", "Posterior Beta", "Posterior Mean E[theta]", "Uncertainty (sigma)", "P(theta > 0.70)", "Quarantine Status"],
390
+ interactive=False,
391
+ )
392
+
393
+ def update_tab1(a0, b0, ns, nf, lam, thresh, gam):
394
+ fig, card, m_val, s_val, lcb_val, p_val = plot_beta_posterior(
395
+ a0, b0, int(ns), int(nf), lam, thresh, gam
396
+ )
397
+ th_df = compute_consecutive_failure_series(a0, b0, gam, thresh)
398
+ return fig, card, m_val, s_val, lcb_val, p_val, th_df
399
+
400
+ inputs_tab1 = [alpha_0_input, beta_0_input, successes_input, failures_input, lambda_input, threshold_input, gamma_input]
401
+ outputs_tab1 = [plot_output, status_html, mean_kpi, sigma_kpi, lcb_kpi, prob_kpi, theorem_table]
402
+
403
+ for comp in inputs_tab1:
404
+ comp.change(fn=update_tab1, inputs=inputs_tab1, outputs=outputs_tab1)
405
+
406
+ demo.load(fn=update_tab1, inputs=inputs_tab1, outputs=outputs_tab1)
407
+
408
+ # TAB 2: Retrieval Ranking Playground
409
+ with gr.TabItem("2. Pessimistic LCB Memory Retrieval"):
410
+ gr.Markdown(
411
+ """
412
+ ### Retrieval Competition: Naive Cosine Similarity vs Pessimistic LCB
413
+ Demonstrates how standard vector RAG repeatedly retrieves corrupted memories with high semantic similarity,
414
+ causing catastrophic cascade failures. Our composite formulation:
415
+ $$\\operatorname{Score}(e; q) = \\operatorname{Sim}(\\mathbf{q}, \\mathbf{v}_e) \\times \\operatorname{LCB}_\\lambda(e)$$
416
+ penalizes uncertain reflections and quarantines verified failures.
417
+ """
418
+ )
419
+ with gr.Row():
420
+ retrieval_lambda = gr.Slider(0.0, 3.0, value=1.0, step=0.25, label="Risk Aversion Parameter (lambda)")
421
+ refresh_retrieval_btn = gr.Button("Recompute Rankings")
422
+
423
+ retrieval_table = gr.Dataframe(interactive=False)
424
+
425
+ gr.Markdown(
426
+ """
427
+ **Key Analytical Observations**:
428
+ - At $\\lambda = 0.0$ (Risk-neutral/Naive Cosine): `MEM-CORRUPT-01` ranks #1 because its cosine similarity is 0.94.
429
+ - At $\\lambda \\ge 1.0$ (Pessimistic LCB): `MEM-CORRUPT-01` is flagged for quarantine, and `MEM-ROBUST-02` (proven with 22 successes) rightfully takes #1 rank.
430
+ - `MEM-UNTESTED-03` with 0 executions receives an uncertainty penalty, preventing the agent from blindly over-trusting unvalidated reflections.
431
+ """
432
+ )
433
+
434
+ def update_retrieval(lam):
435
+ return evaluate_retrieval_ranking(lam)
436
+
437
+ retrieval_lambda.change(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
438
+ refresh_retrieval_btn.click(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
439
+ demo.load(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
440
+
441
+ # TAB 3: Benchmark Traces & Empirical Results
442
+ with gr.TabItem("3. Benchmark Traces & Ablation"):
443
+ gr.Markdown(
444
+ """
445
+ ### Empirical Benchmark Telemetry Summary (1,200 Execution Steps)
446
+ Comparative performance across four controlled experimental conditions under adversarial noise injection (steps 60 to 140).
447
+ """
448
+ )
449
+ summary_df, preview_df = load_benchmark_summary()
450
+
451
+ gr.Markdown("#### Ablation Conditions Summary")
452
+ gr.Dataframe(value=summary_df, interactive=False)
453
+
454
+ gr.Markdown("#### Experiential Memory Bank Sample (100 Verified Records)")
455
+ gr.Dataframe(value=preview_df, interactive=False)
456
+
457
+ gr.Markdown(
458
+ """
459
+ ### Citation
460
+ ```bibtex
461
+ @article{das2026adaptive,
462
+ title={Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval},
463
+ author={Das, Sumit},
464
+ journal={arXiv preprint},
465
+ year={2026}
466
+ }
467
+ ```
468
+ """
469
+ )
470
+
471
+ return demo
472
+
473
+
474
+ if __name__ == "__main__":
475
+ app = build_app()
476
+ app.launch(theme=gr.themes.Soft(primary_hue="blue", neutral_hue="slate"))
data/memory_bank_experiences.csv ADDED
@@ -0,0 +1,101 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ experience_id,task_domain,trigger_condition,strategy_lesson,negative_pitfall,initial_confidence,successes_count,failures_count,total_uses,posterior_mean_trust,posterior_variance,pessimistic_lcb_score,quarantine_status,is_adversarial_sample
2
+ exp_0001,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.91,4,4,8,0.5833,0.018697,0.4466,active,False
3
+ exp_0002,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.823,6,0,6,0.9,0.008182,0.8095,active,False
4
+ exp_0003,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.89,2,2,4,0.625,0.026042,0.4636,active,False
5
+ exp_0004,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.945,7,0,7,0.9091,0.006887,0.8261,active,False
6
+ exp_0005,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.827,10,0,10,0.9286,0.004422,0.8621,active,False
7
+ exp_0006,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.879,2,0,2,0.8333,0.019841,0.6925,active,False
8
+ exp_0007,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.892,0,4,4,0.375,0.026042,0.2136,deprecated,True
9
+ exp_0008,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.855,2,0,2,0.8333,0.019841,0.6925,active,False
10
+ exp_0009,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.83,4,2,6,0.7,0.019091,0.5618,active,False
11
+ exp_0010,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.807,5,1,6,0.8,0.014545,0.6794,active,False
12
+ exp_0011,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.81,6,0,6,0.9,0.008182,0.8095,active,False
13
+ exp_0012,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.921,15,4,19,0.7826,0.007089,0.6984,active,False
14
+ exp_0013,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.903,3,0,3,0.8571,0.015306,0.7334,active,False
15
+ exp_0014,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.874,0,3,3,0.4286,0.030612,0.2536,active,True
16
+ exp_0015,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.839,2,3,5,0.5556,0.024691,0.3984,active,False
17
+ exp_0016,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.878,6,0,6,0.9,0.008182,0.8095,active,False
18
+ exp_0017,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.945,5,0,5,0.8889,0.009877,0.7895,active,False
19
+ exp_0018,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.934,8,4,12,0.6875,0.012638,0.5751,active,False
20
+ exp_0019,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.813,6,3,9,0.6923,0.015216,0.569,active,False
21
+ exp_0020,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.849,2,0,2,0.8333,0.019841,0.6925,active,False
22
+ exp_0021,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.924,0,4,4,0.375,0.026042,0.2136,deprecated,True
23
+ exp_0022,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.881,3,0,3,0.8571,0.015306,0.7334,active,False
24
+ exp_0023,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.811,2,2,4,0.625,0.026042,0.4636,active,False
25
+ exp_0024,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.83,21,2,23,0.8889,0.003527,0.8295,active,False
26
+ exp_0025,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.906,2,2,4,0.625,0.026042,0.4636,active,False
27
+ exp_0026,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.811,7,2,9,0.7692,0.01268,0.6566,active,False
28
+ exp_0027,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.929,3,0,3,0.8571,0.015306,0.7334,active,False
29
+ exp_0028,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.81,1,4,5,0.4444,0.024691,0.2873,active,True
30
+ exp_0029,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.909,3,0,3,0.8571,0.015306,0.7334,active,False
31
+ exp_0030,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.871,6,3,9,0.6923,0.015216,0.569,active,False
32
+ exp_0031,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.914,2,1,3,0.7143,0.02551,0.5546,active,False
33
+ exp_0032,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.874,5,2,7,0.7273,0.016529,0.5987,active,False
34
+ exp_0033,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.804,5,0,5,0.8889,0.009877,0.7895,active,False
35
+ exp_0034,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.895,2,0,2,0.8333,0.019841,0.6925,active,False
36
+ exp_0035,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.936,0,6,6,0.3,0.019091,0.1618,deprecated,True
37
+ exp_0036,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.913,3,0,3,0.8571,0.015306,0.7334,active,False
38
+ exp_0037,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.843,3,0,3,0.8571,0.015306,0.7334,active,False
39
+ exp_0038,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.921,2,3,5,0.5556,0.024691,0.3984,active,False
40
+ exp_0039,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.921,6,2,8,0.75,0.014423,0.6299,active,False
41
+ exp_0040,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.881,2,3,5,0.5556,0.024691,0.3984,active,False
42
+ exp_0041,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.848,9,3,12,0.75,0.011029,0.645,active,False
43
+ exp_0042,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.864,0,4,4,0.375,0.026042,0.2136,deprecated,True
44
+ exp_0043,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.801,9,2,11,0.8,0.01,0.7,active,False
45
+ exp_0044,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.833,5,0,5,0.8889,0.009877,0.7895,active,False
46
+ exp_0045,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.941,2,0,2,0.8333,0.019841,0.6925,active,False
47
+ exp_0046,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.905,3,1,4,0.75,0.020833,0.6057,active,False
48
+ exp_0047,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.944,4,5,9,0.5385,0.017751,0.4052,active,False
49
+ exp_0048,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.845,3,0,3,0.8571,0.015306,0.7334,active,False
50
+ exp_0049,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.891,0,3,3,0.4286,0.030612,0.2536,active,True
51
+ exp_0050,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.842,5,0,5,0.8889,0.009877,0.7895,active,False
52
+ exp_0051,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.822,12,0,12,0.9375,0.003447,0.8788,active,False
53
+ exp_0052,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.836,5,6,11,0.5333,0.015556,0.4086,active,False
54
+ exp_0053,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.836,6,2,8,0.75,0.014423,0.6299,active,False
55
+ exp_0054,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.895,7,0,7,0.9091,0.006887,0.8261,active,False
56
+ exp_0055,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.814,6,1,7,0.8182,0.012397,0.7068,active,False
57
+ exp_0056,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.828,1,4,5,0.4444,0.024691,0.2873,active,True
58
+ exp_0057,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.902,2,1,3,0.7143,0.02551,0.5546,active,False
59
+ exp_0058,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.834,2,1,3,0.7143,0.02551,0.5546,active,False
60
+ exp_0059,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.904,6,0,6,0.9,0.008182,0.8095,active,False
61
+ exp_0060,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.821,4,3,7,0.6364,0.019284,0.4975,active,False
62
+ exp_0061,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.939,3,0,3,0.8571,0.015306,0.7334,active,False
63
+ exp_0062,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.899,11,0,11,0.9333,0.003889,0.871,active,False
64
+ exp_0063,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.879,1,6,7,0.3636,0.019284,0.2248,deprecated,True
65
+ exp_0064,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.935,3,0,3,0.8571,0.015306,0.7334,active,False
66
+ exp_0065,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.851,12,1,13,0.8824,0.005767,0.8064,active,False
67
+ exp_0066,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.935,3,1,4,0.75,0.020833,0.6057,active,False
68
+ exp_0067,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.896,11,2,13,0.8235,0.008074,0.7337,active,False
69
+ exp_0068,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.935,2,0,2,0.8333,0.019841,0.6925,active,False
70
+ exp_0069,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.815,6,0,6,0.9,0.008182,0.8095,active,False
71
+ exp_0070,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.824,1,3,4,0.5,0.027778,0.3333,active,True
72
+ exp_0071,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.898,5,1,6,0.8,0.014545,0.6794,active,False
73
+ exp_0072,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.836,3,1,4,0.75,0.020833,0.6057,active,False
74
+ exp_0073,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.897,3,1,4,0.75,0.020833,0.6057,active,False
75
+ exp_0074,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.885,10,1,11,0.8667,0.007222,0.7817,active,False
76
+ exp_0075,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.84,2,0,2,0.8333,0.019841,0.6925,active,False
77
+ exp_0076,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.859,3,5,8,0.5,0.019231,0.3613,active,False
78
+ exp_0077,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.919,2,7,9,0.3846,0.016906,0.2546,deprecated,True
79
+ exp_0078,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.874,5,1,6,0.8,0.014545,0.6794,active,False
80
+ exp_0079,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.842,2,1,3,0.7143,0.02551,0.5546,active,False
81
+ exp_0080,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.827,2,1,3,0.7143,0.02551,0.5546,active,False
82
+ exp_0081,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.937,14,4,18,0.7727,0.007636,0.6853,active,False
83
+ exp_0082,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.939,4,0,4,0.875,0.012153,0.7648,active,False
84
+ exp_0083,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.945,4,4,8,0.5833,0.018697,0.4466,active,False
85
+ exp_0084,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.858,2,4,6,0.5,0.022727,0.3492,active,True
86
+ exp_0085,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.825,10,0,10,0.9286,0.004422,0.8621,active,False
87
+ exp_0086,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.904,5,3,8,0.6667,0.017094,0.5359,active,False
88
+ exp_0087,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.892,5,0,5,0.8889,0.009877,0.7895,active,False
89
+ exp_0088,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.878,22,0,22,0.9615,0.00137,0.9245,active,False
90
+ exp_0089,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.905,11,1,12,0.875,0.006434,0.7948,active,False
91
+ exp_0090,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.844,7,0,7,0.9091,0.006887,0.8261,active,False
92
+ exp_0091,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.93,1,10,11,0.2667,0.012222,0.1561,deprecated,True
93
+ exp_0092,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.875,12,1,13,0.8824,0.005767,0.8064,active,False
94
+ exp_0093,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.905,9,1,10,0.8571,0.008163,0.7668,active,False
95
+ exp_0094,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.851,9,3,12,0.75,0.011029,0.645,active,False
96
+ exp_0095,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.887,4,0,4,0.875,0.012153,0.7648,active,False
97
+ exp_0096,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.881,2,0,2,0.8333,0.019841,0.6925,active,False
98
+ exp_0097,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.805,3,1,4,0.75,0.020833,0.6057,active,False
99
+ exp_0098,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.854,0,10,10,0.2143,0.011224,0.1083,deprecated,True
100
+ exp_0099,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.915,2,1,3,0.7143,0.02551,0.5546,active,False
101
+ exp_0100,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.813,3,1,4,0.75,0.020833,0.6057,active,False
data/telemetry_traces.csv ADDED
@@ -0,0 +1,1201 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ trial_id,ablation_condition,step_index,task_domain,cosine_similarity,observed_reward,task_success,cumulative_accuracy,in_poison_injection_regime,quarantine_triggered
2
+ 1,vanilla_baseline,1,research,0.731,0.91,1,1.0,False,False
3
+ 2,vanilla_baseline,2,analysis,0.86,0.35,0,0.5,False,False
4
+ 3,vanilla_baseline,3,planning,0.834,0.95,1,0.6667,False,False
5
+ 4,vanilla_baseline,4,coding,0.78,0.86,1,0.75,False,False
6
+ 5,vanilla_baseline,5,research,0.726,0.32,0,0.6,False,False
7
+ 6,vanilla_baseline,6,analysis,0.873,0.87,1,0.6667,False,False
8
+ 7,vanilla_baseline,7,planning,0.754,0.92,1,0.7143,False,False
9
+ 8,vanilla_baseline,8,coding,0.877,0.21,0,0.625,False,False
10
+ 9,vanilla_baseline,9,research,0.93,0.26,0,0.5556,False,False
11
+ 10,vanilla_baseline,10,analysis,0.855,0.88,1,0.6,False,False
12
+ 11,vanilla_baseline,11,planning,0.798,0.15,0,0.5455,False,False
13
+ 12,vanilla_baseline,12,coding,0.746,0.85,1,0.5833,False,False
14
+ 13,vanilla_baseline,13,research,0.908,0.24,0,0.5385,False,False
15
+ 14,vanilla_baseline,14,analysis,0.742,0.91,1,0.5714,False,False
16
+ 15,vanilla_baseline,15,planning,0.758,0.9,1,0.6,False,False
17
+ 16,vanilla_baseline,16,coding,0.855,0.86,1,0.625,False,False
18
+ 17,vanilla_baseline,17,research,0.802,0.91,1,0.6471,False,False
19
+ 18,vanilla_baseline,18,analysis,0.908,0.18,0,0.6111,False,False
20
+ 19,vanilla_baseline,19,planning,0.736,0.85,1,0.6316,False,False
21
+ 20,vanilla_baseline,20,coding,0.849,0.27,0,0.6,False,False
22
+ 21,vanilla_baseline,21,research,0.805,0.9,1,0.619,False,False
23
+ 22,vanilla_baseline,22,analysis,0.84,0.23,0,0.5909,False,False
24
+ 23,vanilla_baseline,23,planning,0.931,0.19,0,0.5652,False,False
25
+ 24,vanilla_baseline,24,coding,0.735,0.85,1,0.5833,False,False
26
+ 25,vanilla_baseline,25,research,0.741,0.16,0,0.56,False,False
27
+ 26,vanilla_baseline,26,analysis,0.79,0.15,0,0.5385,False,False
28
+ 27,vanilla_baseline,27,planning,0.899,0.86,1,0.5556,False,False
29
+ 28,vanilla_baseline,28,coding,0.873,0.96,1,0.5714,False,False
30
+ 29,vanilla_baseline,29,research,0.882,0.21,0,0.5517,False,False
31
+ 30,vanilla_baseline,30,analysis,0.759,0.31,0,0.5333,False,False
32
+ 31,vanilla_baseline,31,planning,0.938,0.89,1,0.5484,False,False
33
+ 32,vanilla_baseline,32,coding,0.891,0.96,1,0.5625,False,False
34
+ 33,vanilla_baseline,33,research,0.909,0.94,1,0.5758,False,False
35
+ 34,vanilla_baseline,34,analysis,0.886,0.96,1,0.5882,False,False
36
+ 35,vanilla_baseline,35,planning,0.831,0.21,0,0.5714,False,False
37
+ 36,vanilla_baseline,36,coding,0.917,0.85,1,0.5833,False,False
38
+ 37,vanilla_baseline,37,research,0.919,0.89,1,0.5946,False,False
39
+ 38,vanilla_baseline,38,analysis,0.929,0.26,0,0.5789,False,False
40
+ 39,vanilla_baseline,39,planning,0.859,0.89,1,0.5897,False,False
41
+ 40,vanilla_baseline,40,coding,0.792,0.3,0,0.575,False,False
42
+ 41,vanilla_baseline,41,research,0.894,0.17,0,0.561,False,False
43
+ 42,vanilla_baseline,42,analysis,0.829,0.92,1,0.5714,False,False
44
+ 43,vanilla_baseline,43,planning,0.817,0.22,0,0.5581,False,False
45
+ 44,vanilla_baseline,44,coding,0.746,0.94,1,0.5682,False,False
46
+ 45,vanilla_baseline,45,research,0.856,0.86,1,0.5778,False,False
47
+ 46,vanilla_baseline,46,analysis,0.874,0.95,1,0.587,False,False
48
+ 47,vanilla_baseline,47,planning,0.875,0.86,1,0.5957,False,False
49
+ 48,vanilla_baseline,48,coding,0.937,0.89,1,0.6042,False,False
50
+ 49,vanilla_baseline,49,research,0.899,0.35,0,0.5918,False,False
51
+ 50,vanilla_baseline,50,analysis,0.886,0.86,1,0.6,False,False
52
+ 51,vanilla_baseline,51,planning,0.891,0.9,1,0.6078,False,False
53
+ 52,vanilla_baseline,52,coding,0.919,0.91,1,0.6154,False,False
54
+ 53,vanilla_baseline,53,research,0.722,0.86,1,0.6226,False,False
55
+ 54,vanilla_baseline,54,analysis,0.746,0.93,1,0.6296,False,False
56
+ 55,vanilla_baseline,55,planning,0.884,0.97,1,0.6364,False,False
57
+ 56,vanilla_baseline,56,coding,0.802,0.95,1,0.6429,False,False
58
+ 57,vanilla_baseline,57,research,0.769,0.15,0,0.6316,False,False
59
+ 58,vanilla_baseline,58,analysis,0.933,0.96,1,0.6379,False,False
60
+ 59,vanilla_baseline,59,planning,0.836,0.16,0,0.6271,False,False
61
+ 60,vanilla_baseline,60,coding,0.842,0.25,0,0.6167,True,False
62
+ 61,vanilla_baseline,61,research,0.858,0.24,0,0.6066,True,False
63
+ 62,vanilla_baseline,62,analysis,0.858,0.96,1,0.6129,True,False
64
+ 63,vanilla_baseline,63,planning,0.73,0.96,1,0.619,True,False
65
+ 64,vanilla_baseline,64,coding,0.916,0.92,1,0.625,True,False
66
+ 65,vanilla_baseline,65,research,0.781,0.91,1,0.6308,True,False
67
+ 66,vanilla_baseline,66,analysis,0.798,0.86,1,0.6364,True,False
68
+ 67,vanilla_baseline,67,planning,0.934,0.29,0,0.6269,True,False
69
+ 68,vanilla_baseline,68,coding,0.838,0.95,1,0.6324,True,False
70
+ 69,vanilla_baseline,69,research,0.871,0.96,1,0.6377,True,False
71
+ 70,vanilla_baseline,70,analysis,0.901,0.3,0,0.6286,True,False
72
+ 71,vanilla_baseline,71,planning,0.855,0.96,1,0.6338,True,False
73
+ 72,vanilla_baseline,72,coding,0.911,0.85,1,0.6389,True,False
74
+ 73,vanilla_baseline,73,research,0.803,0.35,0,0.6301,True,False
75
+ 74,vanilla_baseline,74,analysis,0.753,0.9,1,0.6351,True,False
76
+ 75,vanilla_baseline,75,planning,0.933,0.32,0,0.6267,True,False
77
+ 76,vanilla_baseline,76,coding,0.823,0.88,1,0.6316,True,False
78
+ 77,vanilla_baseline,77,research,0.732,0.31,0,0.6234,True,False
79
+ 78,vanilla_baseline,78,analysis,0.94,0.26,0,0.6154,True,False
80
+ 79,vanilla_baseline,79,planning,0.889,0.32,0,0.6076,True,False
81
+ 80,vanilla_baseline,80,coding,0.774,0.87,1,0.6125,True,False
82
+ 81,vanilla_baseline,81,research,0.93,0.88,1,0.6173,True,False
83
+ 82,vanilla_baseline,82,analysis,0.868,0.89,1,0.622,True,False
84
+ 83,vanilla_baseline,83,planning,0.745,0.25,0,0.6145,True,False
85
+ 84,vanilla_baseline,84,coding,0.89,0.95,1,0.619,True,False
86
+ 85,vanilla_baseline,85,research,0.841,0.96,1,0.6235,True,False
87
+ 86,vanilla_baseline,86,analysis,0.809,0.85,1,0.6279,True,False
88
+ 87,vanilla_baseline,87,planning,0.886,0.93,1,0.6322,True,False
89
+ 88,vanilla_baseline,88,coding,0.767,0.85,1,0.6364,True,False
90
+ 89,vanilla_baseline,89,research,0.797,0.9,1,0.6404,True,False
91
+ 90,vanilla_baseline,90,analysis,0.816,0.22,0,0.6333,True,False
92
+ 91,vanilla_baseline,91,planning,0.833,0.23,0,0.6264,True,False
93
+ 92,vanilla_baseline,92,coding,0.857,0.34,0,0.6196,True,False
94
+ 93,vanilla_baseline,93,research,0.752,0.25,0,0.6129,True,False
95
+ 94,vanilla_baseline,94,analysis,0.777,0.97,1,0.617,True,False
96
+ 95,vanilla_baseline,95,planning,0.828,0.93,1,0.6211,True,False
97
+ 96,vanilla_baseline,96,coding,0.773,0.87,1,0.625,True,False
98
+ 97,vanilla_baseline,97,research,0.748,0.87,1,0.6289,True,False
99
+ 98,vanilla_baseline,98,analysis,0.861,0.89,1,0.6327,True,False
100
+ 99,vanilla_baseline,99,planning,0.917,0.93,1,0.6364,True,False
101
+ 100,vanilla_baseline,100,coding,0.758,0.85,1,0.64,True,False
102
+ 101,vanilla_baseline,101,research,0.757,0.87,1,0.6436,True,False
103
+ 102,vanilla_baseline,102,analysis,0.74,0.91,1,0.6471,True,False
104
+ 103,vanilla_baseline,103,planning,0.765,0.91,1,0.6505,True,False
105
+ 104,vanilla_baseline,104,coding,0.872,0.95,1,0.6538,True,False
106
+ 105,vanilla_baseline,105,research,0.858,0.95,1,0.6571,True,False
107
+ 106,vanilla_baseline,106,analysis,0.923,0.88,1,0.6604,True,False
108
+ 107,vanilla_baseline,107,planning,0.897,0.19,0,0.6542,True,False
109
+ 108,vanilla_baseline,108,coding,0.766,0.91,1,0.6574,True,False
110
+ 109,vanilla_baseline,109,research,0.856,0.91,1,0.6606,True,False
111
+ 110,vanilla_baseline,110,analysis,0.884,0.88,1,0.6636,True,False
112
+ 111,vanilla_baseline,111,planning,0.877,0.25,0,0.6577,True,False
113
+ 112,vanilla_baseline,112,coding,0.837,0.9,1,0.6607,True,False
114
+ 113,vanilla_baseline,113,research,0.837,0.88,1,0.6637,True,False
115
+ 114,vanilla_baseline,114,analysis,0.803,0.89,1,0.6667,True,False
116
+ 115,vanilla_baseline,115,planning,0.767,0.86,1,0.6696,True,False
117
+ 116,vanilla_baseline,116,coding,0.916,0.93,1,0.6724,True,False
118
+ 117,vanilla_baseline,117,research,0.894,0.86,1,0.6752,True,False
119
+ 118,vanilla_baseline,118,analysis,0.838,0.94,1,0.678,True,False
120
+ 119,vanilla_baseline,119,planning,0.815,0.88,1,0.6807,True,False
121
+ 120,vanilla_baseline,120,coding,0.8,0.92,1,0.6833,True,False
122
+ 121,vanilla_baseline,121,research,0.798,0.27,0,0.6777,True,False
123
+ 122,vanilla_baseline,122,analysis,0.772,0.87,1,0.6803,True,False
124
+ 123,vanilla_baseline,123,planning,0.774,0.87,1,0.6829,True,False
125
+ 124,vanilla_baseline,124,coding,0.783,0.96,1,0.6855,True,False
126
+ 125,vanilla_baseline,125,research,0.738,0.9,1,0.688,True,False
127
+ 126,vanilla_baseline,126,analysis,0.936,0.9,1,0.6905,True,False
128
+ 127,vanilla_baseline,127,planning,0.933,0.31,0,0.685,True,False
129
+ 128,vanilla_baseline,128,coding,0.777,0.93,1,0.6875,True,False
130
+ 129,vanilla_baseline,129,research,0.924,0.92,1,0.6899,True,False
131
+ 130,vanilla_baseline,130,analysis,0.782,0.19,0,0.6846,True,False
132
+ 131,vanilla_baseline,131,planning,0.791,0.91,1,0.687,True,False
133
+ 132,vanilla_baseline,132,coding,0.773,0.92,1,0.6894,True,False
134
+ 133,vanilla_baseline,133,research,0.783,0.87,1,0.6917,True,False
135
+ 134,vanilla_baseline,134,analysis,0.826,0.86,1,0.694,True,False
136
+ 135,vanilla_baseline,135,planning,0.794,0.86,1,0.6963,True,False
137
+ 136,vanilla_baseline,136,coding,0.938,0.95,1,0.6985,True,False
138
+ 137,vanilla_baseline,137,research,0.776,0.3,0,0.6934,True,False
139
+ 138,vanilla_baseline,138,analysis,0.851,0.9,1,0.6957,True,False
140
+ 139,vanilla_baseline,139,planning,0.797,0.32,0,0.6906,True,False
141
+ 140,vanilla_baseline,140,coding,0.932,0.94,1,0.6929,True,False
142
+ 141,vanilla_baseline,141,research,0.926,0.86,1,0.695,False,False
143
+ 142,vanilla_baseline,142,analysis,0.883,0.95,1,0.6972,False,False
144
+ 143,vanilla_baseline,143,planning,0.751,0.19,0,0.6923,False,False
145
+ 144,vanilla_baseline,144,coding,0.756,0.95,1,0.6944,False,False
146
+ 145,vanilla_baseline,145,research,0.866,0.89,1,0.6966,False,False
147
+ 146,vanilla_baseline,146,analysis,0.913,0.95,1,0.6986,False,False
148
+ 147,vanilla_baseline,147,planning,0.817,0.91,1,0.7007,False,False
149
+ 148,vanilla_baseline,148,coding,0.786,0.25,0,0.6959,False,False
150
+ 149,vanilla_baseline,149,research,0.771,0.23,0,0.6913,False,False
151
+ 150,vanilla_baseline,150,analysis,0.84,0.27,0,0.6867,False,False
152
+ 151,vanilla_baseline,151,planning,0.746,0.28,0,0.6821,False,False
153
+ 152,vanilla_baseline,152,coding,0.794,0.95,1,0.6842,False,False
154
+ 153,vanilla_baseline,153,research,0.856,0.96,1,0.6863,False,False
155
+ 154,vanilla_baseline,154,analysis,0.893,0.89,1,0.6883,False,False
156
+ 155,vanilla_baseline,155,planning,0.775,0.16,0,0.6839,False,False
157
+ 156,vanilla_baseline,156,coding,0.845,0.33,0,0.6795,False,False
158
+ 157,vanilla_baseline,157,research,0.795,0.17,0,0.6752,False,False
159
+ 158,vanilla_baseline,158,analysis,0.906,0.9,1,0.6772,False,False
160
+ 159,vanilla_baseline,159,planning,0.895,0.88,1,0.6792,False,False
161
+ 160,vanilla_baseline,160,coding,0.879,0.28,0,0.675,False,False
162
+ 161,vanilla_baseline,161,research,0.873,0.88,1,0.677,False,False
163
+ 162,vanilla_baseline,162,analysis,0.796,0.96,1,0.679,False,False
164
+ 163,vanilla_baseline,163,planning,0.848,0.91,1,0.681,False,False
165
+ 164,vanilla_baseline,164,coding,0.928,0.92,1,0.6829,False,False
166
+ 165,vanilla_baseline,165,research,0.831,0.85,1,0.6848,False,False
167
+ 166,vanilla_baseline,166,analysis,0.912,0.26,0,0.6807,False,False
168
+ 167,vanilla_baseline,167,planning,0.873,0.29,0,0.6766,False,False
169
+ 168,vanilla_baseline,168,coding,0.754,0.92,1,0.6786,False,False
170
+ 169,vanilla_baseline,169,research,0.813,0.34,0,0.6746,False,False
171
+ 170,vanilla_baseline,170,analysis,0.924,0.86,1,0.6765,False,False
172
+ 171,vanilla_baseline,171,planning,0.937,0.17,0,0.6725,False,False
173
+ 172,vanilla_baseline,172,coding,0.923,0.25,0,0.6686,False,False
174
+ 173,vanilla_baseline,173,research,0.85,0.86,1,0.6705,False,False
175
+ 174,vanilla_baseline,174,analysis,0.794,0.15,0,0.6667,False,False
176
+ 175,vanilla_baseline,175,planning,0.793,0.91,1,0.6686,False,False
177
+ 176,vanilla_baseline,176,coding,0.922,0.89,1,0.6705,False,False
178
+ 177,vanilla_baseline,177,research,0.882,0.88,1,0.6723,False,False
179
+ 178,vanilla_baseline,178,analysis,0.82,0.87,1,0.6742,False,False
180
+ 179,vanilla_baseline,179,planning,0.83,0.96,1,0.676,False,False
181
+ 180,vanilla_baseline,180,coding,0.8,0.93,1,0.6778,False,False
182
+ 181,vanilla_baseline,181,research,0.723,0.19,0,0.674,False,False
183
+ 182,vanilla_baseline,182,analysis,0.931,0.9,1,0.6758,False,False
184
+ 183,vanilla_baseline,183,planning,0.739,0.25,0,0.6721,False,False
185
+ 184,vanilla_baseline,184,coding,0.851,0.94,1,0.6739,False,False
186
+ 185,vanilla_baseline,185,research,0.766,0.19,0,0.6703,False,False
187
+ 186,vanilla_baseline,186,analysis,0.762,0.91,1,0.672,False,False
188
+ 187,vanilla_baseline,187,planning,0.844,0.94,1,0.6738,False,False
189
+ 188,vanilla_baseline,188,coding,0.82,0.9,1,0.6755,False,False
190
+ 189,vanilla_baseline,189,research,0.808,0.87,1,0.6772,False,False
191
+ 190,vanilla_baseline,190,analysis,0.76,0.34,0,0.6737,False,False
192
+ 191,vanilla_baseline,191,planning,0.802,0.93,1,0.6754,False,False
193
+ 192,vanilla_baseline,192,coding,0.81,0.87,1,0.6771,False,False
194
+ 193,vanilla_baseline,193,research,0.878,0.16,0,0.6736,False,False
195
+ 194,vanilla_baseline,194,analysis,0.769,0.93,1,0.6753,False,False
196
+ 195,vanilla_baseline,195,planning,0.724,0.95,1,0.6769,False,False
197
+ 196,vanilla_baseline,196,coding,0.759,0.2,0,0.6735,False,False
198
+ 197,vanilla_baseline,197,research,0.742,0.94,1,0.6751,False,False
199
+ 198,vanilla_baseline,198,analysis,0.908,0.23,0,0.6717,False,False
200
+ 199,vanilla_baseline,199,planning,0.867,0.89,1,0.6734,False,False
201
+ 200,vanilla_baseline,200,coding,0.917,0.86,1,0.675,False,False
202
+ 201,vanilla_baseline,201,research,0.766,0.87,1,0.6766,False,False
203
+ 202,vanilla_baseline,202,analysis,0.848,0.96,1,0.6782,False,False
204
+ 203,vanilla_baseline,203,planning,0.9,0.88,1,0.6798,False,False
205
+ 204,vanilla_baseline,204,coding,0.804,0.88,1,0.6814,False,False
206
+ 205,vanilla_baseline,205,research,0.857,0.92,1,0.6829,False,False
207
+ 206,vanilla_baseline,206,analysis,0.816,0.96,1,0.6845,False,False
208
+ 207,vanilla_baseline,207,planning,0.888,0.95,1,0.686,False,False
209
+ 208,vanilla_baseline,208,coding,0.827,0.31,0,0.6827,False,False
210
+ 209,vanilla_baseline,209,research,0.814,0.88,1,0.6842,False,False
211
+ 210,vanilla_baseline,210,analysis,0.839,0.88,1,0.6857,False,False
212
+ 211,vanilla_baseline,211,planning,0.751,0.35,0,0.6825,False,False
213
+ 212,vanilla_baseline,212,coding,0.836,0.88,1,0.684,False,False
214
+ 213,vanilla_baseline,213,research,0.724,0.17,0,0.6808,False,False
215
+ 214,vanilla_baseline,214,analysis,0.847,0.92,1,0.6822,False,False
216
+ 215,vanilla_baseline,215,planning,0.863,0.19,0,0.6791,False,False
217
+ 216,vanilla_baseline,216,coding,0.722,0.96,1,0.6806,False,False
218
+ 217,vanilla_baseline,217,research,0.912,0.92,1,0.682,False,False
219
+ 218,vanilla_baseline,218,analysis,0.866,0.96,1,0.6835,False,False
220
+ 219,vanilla_baseline,219,planning,0.812,0.91,1,0.6849,False,False
221
+ 220,vanilla_baseline,220,coding,0.73,0.94,1,0.6864,False,False
222
+ 221,vanilla_baseline,221,research,0.738,0.88,1,0.6878,False,False
223
+ 222,vanilla_baseline,222,analysis,0.806,0.89,1,0.6892,False,False
224
+ 223,vanilla_baseline,223,planning,0.878,0.92,1,0.6906,False,False
225
+ 224,vanilla_baseline,224,coding,0.825,0.34,0,0.6875,False,False
226
+ 225,vanilla_baseline,225,research,0.881,0.85,1,0.6889,False,False
227
+ 226,vanilla_baseline,226,analysis,0.778,0.86,1,0.6903,False,False
228
+ 227,vanilla_baseline,227,planning,0.829,0.89,1,0.6916,False,False
229
+ 228,vanilla_baseline,228,coding,0.89,0.86,1,0.693,False,False
230
+ 229,vanilla_baseline,229,research,0.88,0.93,1,0.6943,False,False
231
+ 230,vanilla_baseline,230,analysis,0.816,0.95,1,0.6957,False,False
232
+ 231,vanilla_baseline,231,planning,0.896,0.2,0,0.6926,False,False
233
+ 232,vanilla_baseline,232,coding,0.85,0.86,1,0.694,False,False
234
+ 233,vanilla_baseline,233,research,0.922,0.96,1,0.6953,False,False
235
+ 234,vanilla_baseline,234,analysis,0.818,0.92,1,0.6966,False,False
236
+ 235,vanilla_baseline,235,planning,0.912,0.31,0,0.6936,False,False
237
+ 236,vanilla_baseline,236,coding,0.865,0.32,0,0.6907,False,False
238
+ 237,vanilla_baseline,237,research,0.775,0.88,1,0.692,False,False
239
+ 238,vanilla_baseline,238,analysis,0.937,0.16,0,0.6891,False,False
240
+ 239,vanilla_baseline,239,planning,0.875,0.19,0,0.6862,False,False
241
+ 240,vanilla_baseline,240,coding,0.845,0.16,0,0.6833,False,False
242
+ 241,vanilla_baseline,241,research,0.873,0.96,1,0.6846,False,False
243
+ 242,vanilla_baseline,242,analysis,0.934,0.24,0,0.6818,False,False
244
+ 243,vanilla_baseline,243,planning,0.91,0.21,0,0.679,False,False
245
+ 244,vanilla_baseline,244,coding,0.902,0.92,1,0.6803,False,False
246
+ 245,vanilla_baseline,245,research,0.771,0.86,1,0.6816,False,False
247
+ 246,vanilla_baseline,246,analysis,0.873,0.94,1,0.6829,False,False
248
+ 247,vanilla_baseline,247,planning,0.734,0.91,1,0.6842,False,False
249
+ 248,vanilla_baseline,248,coding,0.894,0.93,1,0.6855,False,False
250
+ 249,vanilla_baseline,249,research,0.915,0.88,1,0.6867,False,False
251
+ 250,vanilla_baseline,250,analysis,0.725,0.15,0,0.684,False,False
252
+ 251,vanilla_baseline,251,planning,0.912,0.96,1,0.6853,False,False
253
+ 252,vanilla_baseline,252,coding,0.896,0.22,0,0.6825,False,False
254
+ 253,vanilla_baseline,253,research,0.889,0.91,1,0.6838,False,False
255
+ 254,vanilla_baseline,254,analysis,0.858,0.35,0,0.6811,False,False
256
+ 255,vanilla_baseline,255,planning,0.889,0.9,1,0.6824,False,False
257
+ 256,vanilla_baseline,256,coding,0.882,0.86,1,0.6836,False,False
258
+ 257,vanilla_baseline,257,research,0.798,0.89,1,0.6848,False,False
259
+ 258,vanilla_baseline,258,analysis,0.771,0.85,1,0.686,False,False
260
+ 259,vanilla_baseline,259,planning,0.937,0.9,1,0.6873,False,False
261
+ 260,vanilla_baseline,260,coding,0.87,0.96,1,0.6885,False,False
262
+ 261,vanilla_baseline,261,research,0.893,0.9,1,0.6897,False,False
263
+ 262,vanilla_baseline,262,analysis,0.913,0.24,0,0.687,False,False
264
+ 263,vanilla_baseline,263,planning,0.855,0.97,1,0.6882,False,False
265
+ 264,vanilla_baseline,264,coding,0.771,0.28,0,0.6856,False,False
266
+ 265,vanilla_baseline,265,research,0.854,0.88,1,0.6868,False,False
267
+ 266,vanilla_baseline,266,analysis,0.759,0.87,1,0.688,False,False
268
+ 267,vanilla_baseline,267,planning,0.892,0.86,1,0.6891,False,False
269
+ 268,vanilla_baseline,268,coding,0.933,0.34,0,0.6866,False,False
270
+ 269,vanilla_baseline,269,research,0.939,0.9,1,0.6877,False,False
271
+ 270,vanilla_baseline,270,analysis,0.887,0.18,0,0.6852,False,False
272
+ 271,vanilla_baseline,271,planning,0.899,0.88,1,0.6863,False,False
273
+ 272,vanilla_baseline,272,coding,0.838,0.92,1,0.6875,False,False
274
+ 273,vanilla_baseline,273,research,0.74,0.2,0,0.685,False,False
275
+ 274,vanilla_baseline,274,analysis,0.748,0.34,0,0.6825,False,False
276
+ 275,vanilla_baseline,275,planning,0.91,0.28,0,0.68,False,False
277
+ 276,vanilla_baseline,276,coding,0.841,0.9,1,0.6812,False,False
278
+ 277,vanilla_baseline,277,research,0.802,0.94,1,0.6823,False,False
279
+ 278,vanilla_baseline,278,analysis,0.829,0.88,1,0.6835,False,False
280
+ 279,vanilla_baseline,279,planning,0.87,0.95,1,0.6846,False,False
281
+ 280,vanilla_baseline,280,coding,0.829,0.92,1,0.6857,False,False
282
+ 281,vanilla_baseline,281,research,0.901,0.93,1,0.6868,False,False
283
+ 282,vanilla_baseline,282,analysis,0.844,0.96,1,0.6879,False,False
284
+ 283,vanilla_baseline,283,planning,0.895,0.32,0,0.6855,False,False
285
+ 284,vanilla_baseline,284,coding,0.911,0.32,0,0.6831,False,False
286
+ 285,vanilla_baseline,285,research,0.873,0.27,0,0.6807,False,False
287
+ 286,vanilla_baseline,286,analysis,0.886,0.96,1,0.6818,False,False
288
+ 287,vanilla_baseline,287,planning,0.912,0.95,1,0.6829,False,False
289
+ 288,vanilla_baseline,288,coding,0.748,0.94,1,0.684,False,False
290
+ 289,vanilla_baseline,289,research,0.755,0.32,0,0.6817,False,False
291
+ 290,vanilla_baseline,290,analysis,0.832,0.88,1,0.6828,False,False
292
+ 291,vanilla_baseline,291,planning,0.856,0.28,0,0.6804,False,False
293
+ 292,vanilla_baseline,292,coding,0.777,0.91,1,0.6815,False,False
294
+ 293,vanilla_baseline,293,research,0.892,0.94,1,0.6826,False,False
295
+ 294,vanilla_baseline,294,analysis,0.839,0.22,0,0.6803,False,False
296
+ 295,vanilla_baseline,295,planning,0.859,0.17,0,0.678,False,False
297
+ 296,vanilla_baseline,296,coding,0.926,0.16,0,0.6757,False,False
298
+ 297,vanilla_baseline,297,research,0.786,0.16,0,0.6734,False,False
299
+ 298,vanilla_baseline,298,analysis,0.848,0.92,1,0.6745,False,False
300
+ 299,vanilla_baseline,299,planning,0.73,0.34,0,0.6722,False,False
301
+ 300,vanilla_baseline,300,coding,0.933,0.18,0,0.67,False,False
302
+ 301,naive_vector_rag,1,research,0.887,0.85,1,1.0,False,False
303
+ 302,naive_vector_rag,2,analysis,0.791,0.94,1,1.0,False,False
304
+ 303,naive_vector_rag,3,planning,0.87,0.88,1,1.0,False,False
305
+ 304,naive_vector_rag,4,coding,0.939,0.9,1,1.0,False,False
306
+ 305,naive_vector_rag,5,research,0.756,0.93,1,1.0,False,False
307
+ 306,naive_vector_rag,6,analysis,0.769,0.93,1,1.0,False,False
308
+ 307,naive_vector_rag,7,planning,0.864,0.96,1,1.0,False,False
309
+ 308,naive_vector_rag,8,coding,0.753,0.96,1,1.0,False,False
310
+ 309,naive_vector_rag,9,research,0.812,0.9,1,1.0,False,False
311
+ 310,naive_vector_rag,10,analysis,0.78,0.23,0,0.9,False,False
312
+ 311,naive_vector_rag,11,planning,0.917,0.88,1,0.9091,False,False
313
+ 312,naive_vector_rag,12,coding,0.727,0.89,1,0.9167,False,False
314
+ 313,naive_vector_rag,13,research,0.91,0.97,1,0.9231,False,False
315
+ 314,naive_vector_rag,14,analysis,0.761,0.31,0,0.8571,False,False
316
+ 315,naive_vector_rag,15,planning,0.89,0.94,1,0.8667,False,False
317
+ 316,naive_vector_rag,16,coding,0.858,0.85,1,0.875,False,False
318
+ 317,naive_vector_rag,17,research,0.923,0.95,1,0.8824,False,False
319
+ 318,naive_vector_rag,18,analysis,0.826,0.87,1,0.8889,False,False
320
+ 319,naive_vector_rag,19,planning,0.871,0.87,1,0.8947,False,False
321
+ 320,naive_vector_rag,20,coding,0.828,0.92,1,0.9,False,False
322
+ 321,naive_vector_rag,21,research,0.779,0.89,1,0.9048,False,False
323
+ 322,naive_vector_rag,22,analysis,0.82,0.86,1,0.9091,False,False
324
+ 323,naive_vector_rag,23,planning,0.806,0.92,1,0.913,False,False
325
+ 324,naive_vector_rag,24,coding,0.784,0.95,1,0.9167,False,False
326
+ 325,naive_vector_rag,25,research,0.892,0.91,1,0.92,False,False
327
+ 326,naive_vector_rag,26,analysis,0.743,0.97,1,0.9231,False,False
328
+ 327,naive_vector_rag,27,planning,0.751,0.92,1,0.9259,False,False
329
+ 328,naive_vector_rag,28,coding,0.875,0.85,1,0.9286,False,False
330
+ 329,naive_vector_rag,29,research,0.792,0.86,1,0.931,False,False
331
+ 330,naive_vector_rag,30,analysis,0.797,0.86,1,0.9333,False,False
332
+ 331,naive_vector_rag,31,planning,0.807,0.92,1,0.9355,False,False
333
+ 332,naive_vector_rag,32,coding,0.872,0.87,1,0.9375,False,False
334
+ 333,naive_vector_rag,33,research,0.757,0.93,1,0.9394,False,False
335
+ 334,naive_vector_rag,34,analysis,0.875,0.96,1,0.9412,False,False
336
+ 335,naive_vector_rag,35,planning,0.731,0.94,1,0.9429,False,False
337
+ 336,naive_vector_rag,36,coding,0.912,0.95,1,0.9444,False,False
338
+ 337,naive_vector_rag,37,research,0.795,0.86,1,0.9459,False,False
339
+ 338,naive_vector_rag,38,analysis,0.917,0.95,1,0.9474,False,False
340
+ 339,naive_vector_rag,39,planning,0.82,0.91,1,0.9487,False,False
341
+ 340,naive_vector_rag,40,coding,0.881,0.86,1,0.95,False,False
342
+ 341,naive_vector_rag,41,research,0.774,0.95,1,0.9512,False,False
343
+ 342,naive_vector_rag,42,analysis,0.768,0.22,0,0.9286,False,False
344
+ 343,naive_vector_rag,43,planning,0.76,0.93,1,0.9302,False,False
345
+ 344,naive_vector_rag,44,coding,0.83,0.94,1,0.9318,False,False
346
+ 345,naive_vector_rag,45,research,0.77,0.34,0,0.9111,False,False
347
+ 346,naive_vector_rag,46,analysis,0.863,0.93,1,0.913,False,False
348
+ 347,naive_vector_rag,47,planning,0.736,0.88,1,0.9149,False,False
349
+ 348,naive_vector_rag,48,coding,0.822,0.3,0,0.8958,False,False
350
+ 349,naive_vector_rag,49,research,0.883,0.89,1,0.898,False,False
351
+ 350,naive_vector_rag,50,analysis,0.802,0.16,0,0.88,False,False
352
+ 351,naive_vector_rag,51,planning,0.911,0.9,1,0.8824,False,False
353
+ 352,naive_vector_rag,52,coding,0.88,0.95,1,0.8846,False,False
354
+ 353,naive_vector_rag,53,research,0.918,0.88,1,0.8868,False,False
355
+ 354,naive_vector_rag,54,analysis,0.85,0.19,0,0.8704,False,False
356
+ 355,naive_vector_rag,55,planning,0.857,0.94,1,0.8727,False,False
357
+ 356,naive_vector_rag,56,coding,0.749,0.96,1,0.875,False,False
358
+ 357,naive_vector_rag,57,research,0.76,0.97,1,0.8772,False,False
359
+ 358,naive_vector_rag,58,analysis,0.76,0.25,0,0.8621,False,False
360
+ 359,naive_vector_rag,59,planning,0.774,0.24,0,0.8475,False,False
361
+ 360,naive_vector_rag,60,coding,0.833,0.27,0,0.8333,True,False
362
+ 361,naive_vector_rag,61,research,0.756,0.34,0,0.8197,True,False
363
+ 362,naive_vector_rag,62,analysis,0.777,0.22,0,0.8065,True,False
364
+ 363,naive_vector_rag,63,planning,0.89,0.97,1,0.8095,True,False
365
+ 364,naive_vector_rag,64,coding,0.82,0.16,0,0.7969,True,False
366
+ 365,naive_vector_rag,65,research,0.757,0.22,0,0.7846,True,False
367
+ 366,naive_vector_rag,66,analysis,0.902,0.2,0,0.7727,True,False
368
+ 367,naive_vector_rag,67,planning,0.856,0.18,0,0.7612,True,False
369
+ 368,naive_vector_rag,68,coding,0.757,0.94,1,0.7647,True,False
370
+ 369,naive_vector_rag,69,research,0.866,0.32,0,0.7536,True,False
371
+ 370,naive_vector_rag,70,analysis,0.897,0.32,0,0.7429,True,False
372
+ 371,naive_vector_rag,71,planning,0.765,0.88,1,0.7465,True,False
373
+ 372,naive_vector_rag,72,coding,0.733,0.34,0,0.7361,True,False
374
+ 373,naive_vector_rag,73,research,0.729,0.9,1,0.7397,True,False
375
+ 374,naive_vector_rag,74,analysis,0.925,0.25,0,0.7297,True,False
376
+ 375,naive_vector_rag,75,planning,0.729,0.97,1,0.7333,True,False
377
+ 376,naive_vector_rag,76,coding,0.932,0.96,1,0.7368,True,False
378
+ 377,naive_vector_rag,77,research,0.861,0.24,0,0.7273,True,False
379
+ 378,naive_vector_rag,78,analysis,0.833,0.28,0,0.7179,True,False
380
+ 379,naive_vector_rag,79,planning,0.751,0.89,1,0.7215,True,False
381
+ 380,naive_vector_rag,80,coding,0.875,0.93,1,0.725,True,False
382
+ 381,naive_vector_rag,81,research,0.933,0.93,1,0.7284,True,False
383
+ 382,naive_vector_rag,82,analysis,0.818,0.19,0,0.7195,True,False
384
+ 383,naive_vector_rag,83,planning,0.872,0.34,0,0.7108,True,False
385
+ 384,naive_vector_rag,84,coding,0.87,0.27,0,0.7024,True,False
386
+ 385,naive_vector_rag,85,research,0.911,0.16,0,0.6941,True,False
387
+ 386,naive_vector_rag,86,analysis,0.925,0.29,0,0.686,True,False
388
+ 387,naive_vector_rag,87,planning,0.767,0.23,0,0.6782,True,False
389
+ 388,naive_vector_rag,88,coding,0.863,0.93,1,0.6818,True,False
390
+ 389,naive_vector_rag,89,research,0.94,0.97,1,0.6854,True,False
391
+ 390,naive_vector_rag,90,analysis,0.81,0.31,0,0.6778,True,False
392
+ 391,naive_vector_rag,91,planning,0.845,0.33,0,0.6703,True,False
393
+ 392,naive_vector_rag,92,coding,0.809,0.28,0,0.663,True,False
394
+ 393,naive_vector_rag,93,research,0.898,0.31,0,0.6559,True,False
395
+ 394,naive_vector_rag,94,analysis,0.816,0.17,0,0.6489,True,False
396
+ 395,naive_vector_rag,95,planning,0.84,0.89,1,0.6526,True,False
397
+ 396,naive_vector_rag,96,coding,0.801,0.29,0,0.6458,True,False
398
+ 397,naive_vector_rag,97,research,0.805,0.2,0,0.6392,True,False
399
+ 398,naive_vector_rag,98,analysis,0.802,0.16,0,0.6327,True,False
400
+ 399,naive_vector_rag,99,planning,0.853,0.27,0,0.6263,True,False
401
+ 400,naive_vector_rag,100,coding,0.822,0.32,0,0.62,True,False
402
+ 401,naive_vector_rag,101,research,0.834,0.16,0,0.6139,True,False
403
+ 402,naive_vector_rag,102,analysis,0.795,0.23,0,0.6078,True,False
404
+ 403,naive_vector_rag,103,planning,0.848,0.27,0,0.6019,True,False
405
+ 404,naive_vector_rag,104,coding,0.888,0.29,0,0.5962,True,False
406
+ 405,naive_vector_rag,105,research,0.93,0.87,1,0.6,True,False
407
+ 406,naive_vector_rag,106,analysis,0.722,0.33,0,0.5943,True,False
408
+ 407,naive_vector_rag,107,planning,0.774,0.16,0,0.5888,True,False
409
+ 408,naive_vector_rag,108,coding,0.926,0.17,0,0.5833,True,False
410
+ 409,naive_vector_rag,109,research,0.827,0.21,0,0.578,True,False
411
+ 410,naive_vector_rag,110,analysis,0.788,0.26,0,0.5727,True,False
412
+ 411,naive_vector_rag,111,planning,0.788,0.29,0,0.5676,True,False
413
+ 412,naive_vector_rag,112,coding,0.78,0.17,0,0.5625,True,False
414
+ 413,naive_vector_rag,113,research,0.76,0.19,0,0.5575,True,False
415
+ 414,naive_vector_rag,114,analysis,0.836,0.17,0,0.5526,True,False
416
+ 415,naive_vector_rag,115,planning,0.845,0.34,0,0.5478,True,False
417
+ 416,naive_vector_rag,116,coding,0.826,0.26,0,0.5431,True,False
418
+ 417,naive_vector_rag,117,research,0.73,0.34,0,0.5385,True,False
419
+ 418,naive_vector_rag,118,analysis,0.852,0.33,0,0.5339,True,False
420
+ 419,naive_vector_rag,119,planning,0.77,0.92,1,0.5378,True,False
421
+ 420,naive_vector_rag,120,coding,0.81,0.33,0,0.5333,True,False
422
+ 421,naive_vector_rag,121,research,0.798,0.31,0,0.5289,True,False
423
+ 422,naive_vector_rag,122,analysis,0.78,0.23,0,0.5246,True,False
424
+ 423,naive_vector_rag,123,planning,0.867,0.92,1,0.5285,True,False
425
+ 424,naive_vector_rag,124,coding,0.819,0.18,0,0.5242,True,False
426
+ 425,naive_vector_rag,125,research,0.882,0.19,0,0.52,True,False
427
+ 426,naive_vector_rag,126,analysis,0.741,0.93,1,0.5238,True,False
428
+ 427,naive_vector_rag,127,planning,0.854,0.2,0,0.5197,True,False
429
+ 428,naive_vector_rag,128,coding,0.806,0.25,0,0.5156,True,False
430
+ 429,naive_vector_rag,129,research,0.937,0.93,1,0.5194,True,False
431
+ 430,naive_vector_rag,130,analysis,0.809,0.29,0,0.5154,True,False
432
+ 431,naive_vector_rag,131,planning,0.872,0.18,0,0.5115,True,False
433
+ 432,naive_vector_rag,132,coding,0.743,0.27,0,0.5076,True,False
434
+ 433,naive_vector_rag,133,research,0.78,0.86,1,0.5113,True,False
435
+ 434,naive_vector_rag,134,analysis,0.917,0.89,1,0.5149,True,False
436
+ 435,naive_vector_rag,135,planning,0.77,0.16,0,0.5111,True,False
437
+ 436,naive_vector_rag,136,coding,0.834,0.95,1,0.5147,True,False
438
+ 437,naive_vector_rag,137,research,0.771,0.33,0,0.5109,True,False
439
+ 438,naive_vector_rag,138,analysis,0.863,0.21,0,0.5072,True,False
440
+ 439,naive_vector_rag,139,planning,0.793,0.35,0,0.5036,True,False
441
+ 440,naive_vector_rag,140,coding,0.866,0.3,0,0.5,True,False
442
+ 441,naive_vector_rag,141,research,0.822,0.92,1,0.5035,False,False
443
+ 442,naive_vector_rag,142,analysis,0.931,0.93,1,0.507,False,False
444
+ 443,naive_vector_rag,143,planning,0.764,0.86,1,0.5105,False,False
445
+ 444,naive_vector_rag,144,coding,0.819,0.89,1,0.5139,False,False
446
+ 445,naive_vector_rag,145,research,0.866,0.96,1,0.5172,False,False
447
+ 446,naive_vector_rag,146,analysis,0.772,0.87,1,0.5205,False,False
448
+ 447,naive_vector_rag,147,planning,0.938,0.26,0,0.517,False,False
449
+ 448,naive_vector_rag,148,coding,0.905,0.92,1,0.5203,False,False
450
+ 449,naive_vector_rag,149,research,0.74,0.87,1,0.5235,False,False
451
+ 450,naive_vector_rag,150,analysis,0.902,0.94,1,0.5267,False,False
452
+ 451,naive_vector_rag,151,planning,0.728,0.88,1,0.5298,False,False
453
+ 452,naive_vector_rag,152,coding,0.799,0.96,1,0.5329,False,False
454
+ 453,naive_vector_rag,153,research,0.842,0.9,1,0.5359,False,False
455
+ 454,naive_vector_rag,154,analysis,0.818,0.91,1,0.539,False,False
456
+ 455,naive_vector_rag,155,planning,0.922,0.97,1,0.5419,False,False
457
+ 456,naive_vector_rag,156,coding,0.907,0.96,1,0.5449,False,False
458
+ 457,naive_vector_rag,157,research,0.746,0.9,1,0.5478,False,False
459
+ 458,naive_vector_rag,158,analysis,0.913,0.31,0,0.5443,False,False
460
+ 459,naive_vector_rag,159,planning,0.894,0.86,1,0.5472,False,False
461
+ 460,naive_vector_rag,160,coding,0.809,0.93,1,0.55,False,False
462
+ 461,naive_vector_rag,161,research,0.796,0.28,0,0.5466,False,False
463
+ 462,naive_vector_rag,162,analysis,0.901,0.95,1,0.5494,False,False
464
+ 463,naive_vector_rag,163,planning,0.923,0.92,1,0.5521,False,False
465
+ 464,naive_vector_rag,164,coding,0.888,0.91,1,0.5549,False,False
466
+ 465,naive_vector_rag,165,research,0.808,0.89,1,0.5576,False,False
467
+ 466,naive_vector_rag,166,analysis,0.735,0.87,1,0.5602,False,False
468
+ 467,naive_vector_rag,167,planning,0.932,0.97,1,0.5629,False,False
469
+ 468,naive_vector_rag,168,coding,0.815,0.91,1,0.5655,False,False
470
+ 469,naive_vector_rag,169,research,0.817,0.93,1,0.568,False,False
471
+ 470,naive_vector_rag,170,analysis,0.768,0.93,1,0.5706,False,False
472
+ 471,naive_vector_rag,171,planning,0.753,0.94,1,0.5731,False,False
473
+ 472,naive_vector_rag,172,coding,0.821,0.97,1,0.5756,False,False
474
+ 473,naive_vector_rag,173,research,0.733,0.97,1,0.578,False,False
475
+ 474,naive_vector_rag,174,analysis,0.773,0.86,1,0.5805,False,False
476
+ 475,naive_vector_rag,175,planning,0.787,0.93,1,0.5829,False,False
477
+ 476,naive_vector_rag,176,coding,0.734,0.97,1,0.5852,False,False
478
+ 477,naive_vector_rag,177,research,0.899,0.89,1,0.5876,False,False
479
+ 478,naive_vector_rag,178,analysis,0.857,0.9,1,0.5899,False,False
480
+ 479,naive_vector_rag,179,planning,0.749,0.24,0,0.5866,False,False
481
+ 480,naive_vector_rag,180,coding,0.763,0.9,1,0.5889,False,False
482
+ 481,naive_vector_rag,181,research,0.902,0.94,1,0.5912,False,False
483
+ 482,naive_vector_rag,182,analysis,0.722,0.91,1,0.5934,False,False
484
+ 483,naive_vector_rag,183,planning,0.724,0.94,1,0.5956,False,False
485
+ 484,naive_vector_rag,184,coding,0.75,0.88,1,0.5978,False,False
486
+ 485,naive_vector_rag,185,research,0.723,0.97,1,0.6,False,False
487
+ 486,naive_vector_rag,186,analysis,0.896,0.25,0,0.5968,False,False
488
+ 487,naive_vector_rag,187,planning,0.744,0.9,1,0.5989,False,False
489
+ 488,naive_vector_rag,188,coding,0.906,0.91,1,0.6011,False,False
490
+ 489,naive_vector_rag,189,research,0.753,0.94,1,0.6032,False,False
491
+ 490,naive_vector_rag,190,analysis,0.825,0.9,1,0.6053,False,False
492
+ 491,naive_vector_rag,191,planning,0.821,0.96,1,0.6073,False,False
493
+ 492,naive_vector_rag,192,coding,0.93,0.89,1,0.6094,False,False
494
+ 493,naive_vector_rag,193,research,0.871,0.88,1,0.6114,False,False
495
+ 494,naive_vector_rag,194,analysis,0.905,0.96,1,0.6134,False,False
496
+ 495,naive_vector_rag,195,planning,0.822,0.93,1,0.6154,False,False
497
+ 496,naive_vector_rag,196,coding,0.917,0.92,1,0.6173,False,False
498
+ 497,naive_vector_rag,197,research,0.735,0.87,1,0.6193,False,False
499
+ 498,naive_vector_rag,198,analysis,0.882,0.93,1,0.6212,False,False
500
+ 499,naive_vector_rag,199,planning,0.729,0.94,1,0.6231,False,False
501
+ 500,naive_vector_rag,200,coding,0.736,0.85,1,0.625,False,False
502
+ 501,naive_vector_rag,201,research,0.93,0.89,1,0.6269,False,False
503
+ 502,naive_vector_rag,202,analysis,0.785,0.94,1,0.6287,False,False
504
+ 503,naive_vector_rag,203,planning,0.866,0.87,1,0.6305,False,False
505
+ 504,naive_vector_rag,204,coding,0.742,0.94,1,0.6324,False,False
506
+ 505,naive_vector_rag,205,research,0.778,0.86,1,0.6341,False,False
507
+ 506,naive_vector_rag,206,analysis,0.933,0.94,1,0.6359,False,False
508
+ 507,naive_vector_rag,207,planning,0.857,0.87,1,0.6377,False,False
509
+ 508,naive_vector_rag,208,coding,0.747,0.94,1,0.6394,False,False
510
+ 509,naive_vector_rag,209,research,0.862,0.86,1,0.6411,False,False
511
+ 510,naive_vector_rag,210,analysis,0.933,0.89,1,0.6429,False,False
512
+ 511,naive_vector_rag,211,planning,0.936,0.92,1,0.6445,False,False
513
+ 512,naive_vector_rag,212,coding,0.885,0.93,1,0.6462,False,False
514
+ 513,naive_vector_rag,213,research,0.748,0.96,1,0.6479,False,False
515
+ 514,naive_vector_rag,214,analysis,0.769,0.9,1,0.6495,False,False
516
+ 515,naive_vector_rag,215,planning,0.817,0.96,1,0.6512,False,False
517
+ 516,naive_vector_rag,216,coding,0.773,0.87,1,0.6528,False,False
518
+ 517,naive_vector_rag,217,research,0.915,0.88,1,0.6544,False,False
519
+ 518,naive_vector_rag,218,analysis,0.9,0.32,0,0.6514,False,False
520
+ 519,naive_vector_rag,219,planning,0.922,0.94,1,0.653,False,False
521
+ 520,naive_vector_rag,220,coding,0.821,0.94,1,0.6545,False,False
522
+ 521,naive_vector_rag,221,research,0.891,0.87,1,0.6561,False,False
523
+ 522,naive_vector_rag,222,analysis,0.84,0.34,0,0.6532,False,False
524
+ 523,naive_vector_rag,223,planning,0.729,0.87,1,0.6547,False,False
525
+ 524,naive_vector_rag,224,coding,0.88,0.88,1,0.6562,False,False
526
+ 525,naive_vector_rag,225,research,0.831,0.94,1,0.6578,False,False
527
+ 526,naive_vector_rag,226,analysis,0.839,0.91,1,0.6593,False,False
528
+ 527,naive_vector_rag,227,planning,0.785,0.93,1,0.6608,False,False
529
+ 528,naive_vector_rag,228,coding,0.912,0.94,1,0.6623,False,False
530
+ 529,naive_vector_rag,229,research,0.755,0.85,1,0.6638,False,False
531
+ 530,naive_vector_rag,230,analysis,0.774,0.97,1,0.6652,False,False
532
+ 531,naive_vector_rag,231,planning,0.742,0.95,1,0.6667,False,False
533
+ 532,naive_vector_rag,232,coding,0.765,0.94,1,0.6681,False,False
534
+ 533,naive_vector_rag,233,research,0.856,0.89,1,0.6695,False,False
535
+ 534,naive_vector_rag,234,analysis,0.892,0.85,1,0.6709,False,False
536
+ 535,naive_vector_rag,235,planning,0.887,0.94,1,0.6723,False,False
537
+ 536,naive_vector_rag,236,coding,0.765,0.22,0,0.6695,False,False
538
+ 537,naive_vector_rag,237,research,0.792,0.89,1,0.6709,False,False
539
+ 538,naive_vector_rag,238,analysis,0.913,0.22,0,0.6681,False,False
540
+ 539,naive_vector_rag,239,planning,0.819,0.96,1,0.6695,False,False
541
+ 540,naive_vector_rag,240,coding,0.85,0.9,1,0.6708,False,False
542
+ 541,naive_vector_rag,241,research,0.873,0.92,1,0.6722,False,False
543
+ 542,naive_vector_rag,242,analysis,0.798,0.86,1,0.6736,False,False
544
+ 543,naive_vector_rag,243,planning,0.849,0.93,1,0.6749,False,False
545
+ 544,naive_vector_rag,244,coding,0.734,0.92,1,0.6762,False,False
546
+ 545,naive_vector_rag,245,research,0.843,0.93,1,0.6776,False,False
547
+ 546,naive_vector_rag,246,analysis,0.897,0.95,1,0.6789,False,False
548
+ 547,naive_vector_rag,247,planning,0.83,0.86,1,0.6802,False,False
549
+ 548,naive_vector_rag,248,coding,0.794,0.93,1,0.6815,False,False
550
+ 549,naive_vector_rag,249,research,0.893,0.9,1,0.6827,False,False
551
+ 550,naive_vector_rag,250,analysis,0.752,0.9,1,0.684,False,False
552
+ 551,naive_vector_rag,251,planning,0.739,0.92,1,0.6853,False,False
553
+ 552,naive_vector_rag,252,coding,0.882,0.34,0,0.6825,False,False
554
+ 553,naive_vector_rag,253,research,0.861,0.93,1,0.6838,False,False
555
+ 554,naive_vector_rag,254,analysis,0.893,0.9,1,0.685,False,False
556
+ 555,naive_vector_rag,255,planning,0.905,0.92,1,0.6863,False,False
557
+ 556,naive_vector_rag,256,coding,0.849,0.89,1,0.6875,False,False
558
+ 557,naive_vector_rag,257,research,0.794,0.85,1,0.6887,False,False
559
+ 558,naive_vector_rag,258,analysis,0.903,0.91,1,0.6899,False,False
560
+ 559,naive_vector_rag,259,planning,0.786,0.2,0,0.6873,False,False
561
+ 560,naive_vector_rag,260,coding,0.815,0.32,0,0.6846,False,False
562
+ 561,naive_vector_rag,261,research,0.761,0.9,1,0.6858,False,False
563
+ 562,naive_vector_rag,262,analysis,0.826,0.86,1,0.687,False,False
564
+ 563,naive_vector_rag,263,planning,0.88,0.9,1,0.6882,False,False
565
+ 564,naive_vector_rag,264,coding,0.88,0.87,1,0.6894,False,False
566
+ 565,naive_vector_rag,265,research,0.854,0.94,1,0.6906,False,False
567
+ 566,naive_vector_rag,266,analysis,0.865,0.16,0,0.688,False,False
568
+ 567,naive_vector_rag,267,planning,0.733,0.88,1,0.6891,False,False
569
+ 568,naive_vector_rag,268,coding,0.774,0.2,0,0.6866,False,False
570
+ 569,naive_vector_rag,269,research,0.78,0.9,1,0.6877,False,False
571
+ 570,naive_vector_rag,270,analysis,0.891,0.91,1,0.6889,False,False
572
+ 571,naive_vector_rag,271,planning,0.727,0.96,1,0.69,False,False
573
+ 572,naive_vector_rag,272,coding,0.751,0.9,1,0.6912,False,False
574
+ 573,naive_vector_rag,273,research,0.796,0.15,0,0.6886,False,False
575
+ 574,naive_vector_rag,274,analysis,0.866,0.26,0,0.6861,False,False
576
+ 575,naive_vector_rag,275,planning,0.926,0.9,1,0.6873,False,False
577
+ 576,naive_vector_rag,276,coding,0.777,0.97,1,0.6884,False,False
578
+ 577,naive_vector_rag,277,research,0.776,0.87,1,0.6895,False,False
579
+ 578,naive_vector_rag,278,analysis,0.844,0.97,1,0.6906,False,False
580
+ 579,naive_vector_rag,279,planning,0.854,0.86,1,0.6918,False,False
581
+ 580,naive_vector_rag,280,coding,0.753,0.88,1,0.6929,False,False
582
+ 581,naive_vector_rag,281,research,0.907,0.91,1,0.694,False,False
583
+ 582,naive_vector_rag,282,analysis,0.745,0.29,0,0.6915,False,False
584
+ 583,naive_vector_rag,283,planning,0.735,0.92,1,0.6926,False,False
585
+ 584,naive_vector_rag,284,coding,0.738,0.91,1,0.6937,False,False
586
+ 585,naive_vector_rag,285,research,0.756,0.32,0,0.6912,False,False
587
+ 586,naive_vector_rag,286,analysis,0.867,0.9,1,0.6923,False,False
588
+ 587,naive_vector_rag,287,planning,0.863,0.86,1,0.6934,False,False
589
+ 588,naive_vector_rag,288,coding,0.833,0.91,1,0.6944,False,False
590
+ 589,naive_vector_rag,289,research,0.731,0.87,1,0.6955,False,False
591
+ 590,naive_vector_rag,290,analysis,0.777,0.89,1,0.6966,False,False
592
+ 591,naive_vector_rag,291,planning,0.886,0.87,1,0.6976,False,False
593
+ 592,naive_vector_rag,292,coding,0.913,0.32,0,0.6952,False,False
594
+ 593,naive_vector_rag,293,research,0.773,0.97,1,0.6962,False,False
595
+ 594,naive_vector_rag,294,analysis,0.89,0.86,1,0.6973,False,False
596
+ 595,naive_vector_rag,295,planning,0.822,0.26,0,0.6949,False,False
597
+ 596,naive_vector_rag,296,coding,0.83,0.93,1,0.6959,False,False
598
+ 597,naive_vector_rag,297,research,0.901,0.94,1,0.697,False,False
599
+ 598,naive_vector_rag,298,analysis,0.932,0.91,1,0.698,False,False
600
+ 599,naive_vector_rag,299,planning,0.783,0.92,1,0.699,False,False
601
+ 600,naive_vector_rag,300,coding,0.86,0.9,1,0.7,False,False
602
+ 601,symmetric_reflexion,1,research,0.921,0.87,1,1.0,False,False
603
+ 602,symmetric_reflexion,2,analysis,0.873,0.89,1,1.0,False,False
604
+ 603,symmetric_reflexion,3,planning,0.909,0.21,0,0.6667,False,False
605
+ 604,symmetric_reflexion,4,coding,0.936,0.87,1,0.75,False,False
606
+ 605,symmetric_reflexion,5,research,0.761,0.28,0,0.6,False,False
607
+ 606,symmetric_reflexion,6,analysis,0.753,0.92,1,0.6667,False,False
608
+ 607,symmetric_reflexion,7,planning,0.738,0.31,0,0.5714,False,False
609
+ 608,symmetric_reflexion,8,coding,0.831,0.23,0,0.5,False,False
610
+ 609,symmetric_reflexion,9,research,0.937,0.93,1,0.5556,False,False
611
+ 610,symmetric_reflexion,10,analysis,0.757,0.24,0,0.5,False,False
612
+ 611,symmetric_reflexion,11,planning,0.756,0.92,1,0.5455,False,False
613
+ 612,symmetric_reflexion,12,coding,0.836,0.96,1,0.5833,False,False
614
+ 613,symmetric_reflexion,13,research,0.737,0.87,1,0.6154,False,False
615
+ 614,symmetric_reflexion,14,analysis,0.909,0.91,1,0.6429,False,False
616
+ 615,symmetric_reflexion,15,planning,0.876,0.91,1,0.6667,False,False
617
+ 616,symmetric_reflexion,16,coding,0.901,0.89,1,0.6875,False,False
618
+ 617,symmetric_reflexion,17,research,0.829,0.89,1,0.7059,False,False
619
+ 618,symmetric_reflexion,18,analysis,0.758,0.95,1,0.7222,False,False
620
+ 619,symmetric_reflexion,19,planning,0.742,0.87,1,0.7368,False,False
621
+ 620,symmetric_reflexion,20,coding,0.797,0.94,1,0.75,False,False
622
+ 621,symmetric_reflexion,21,research,0.863,0.89,1,0.7619,False,False
623
+ 622,symmetric_reflexion,22,analysis,0.905,0.97,1,0.7727,False,False
624
+ 623,symmetric_reflexion,23,planning,0.86,0.93,1,0.7826,False,False
625
+ 624,symmetric_reflexion,24,coding,0.792,0.86,1,0.7917,False,False
626
+ 625,symmetric_reflexion,25,research,0.758,0.2,0,0.76,False,False
627
+ 626,symmetric_reflexion,26,analysis,0.904,0.93,1,0.7692,False,False
628
+ 627,symmetric_reflexion,27,planning,0.873,0.89,1,0.7778,False,False
629
+ 628,symmetric_reflexion,28,coding,0.767,0.89,1,0.7857,False,False
630
+ 629,symmetric_reflexion,29,research,0.864,0.32,0,0.7586,False,False
631
+ 630,symmetric_reflexion,30,analysis,0.889,0.93,1,0.7667,False,False
632
+ 631,symmetric_reflexion,31,planning,0.777,0.28,0,0.7419,False,False
633
+ 632,symmetric_reflexion,32,coding,0.843,0.9,1,0.75,False,False
634
+ 633,symmetric_reflexion,33,research,0.821,0.26,0,0.7273,False,False
635
+ 634,symmetric_reflexion,34,analysis,0.804,0.17,0,0.7059,False,False
636
+ 635,symmetric_reflexion,35,planning,0.813,0.94,1,0.7143,False,False
637
+ 636,symmetric_reflexion,36,coding,0.922,0.95,1,0.7222,False,False
638
+ 637,symmetric_reflexion,37,research,0.784,0.3,0,0.7027,False,False
639
+ 638,symmetric_reflexion,38,analysis,0.897,0.97,1,0.7105,False,False
640
+ 639,symmetric_reflexion,39,planning,0.88,0.95,1,0.7179,False,False
641
+ 640,symmetric_reflexion,40,coding,0.782,0.17,0,0.7,False,False
642
+ 641,symmetric_reflexion,41,research,0.875,0.86,1,0.7073,False,False
643
+ 642,symmetric_reflexion,42,analysis,0.773,0.91,1,0.7143,False,False
644
+ 643,symmetric_reflexion,43,planning,0.786,0.89,1,0.7209,False,False
645
+ 644,symmetric_reflexion,44,coding,0.786,0.86,1,0.7273,False,False
646
+ 645,symmetric_reflexion,45,research,0.919,0.28,0,0.7111,False,False
647
+ 646,symmetric_reflexion,46,analysis,0.851,0.19,0,0.6957,False,False
648
+ 647,symmetric_reflexion,47,planning,0.737,0.95,1,0.7021,False,False
649
+ 648,symmetric_reflexion,48,coding,0.728,0.97,1,0.7083,False,False
650
+ 649,symmetric_reflexion,49,research,0.908,0.86,1,0.7143,False,False
651
+ 650,symmetric_reflexion,50,analysis,0.903,0.86,1,0.72,False,False
652
+ 651,symmetric_reflexion,51,planning,0.741,0.28,0,0.7059,False,False
653
+ 652,symmetric_reflexion,52,coding,0.902,0.26,0,0.6923,False,False
654
+ 653,symmetric_reflexion,53,research,0.834,0.89,1,0.6981,False,False
655
+ 654,symmetric_reflexion,54,analysis,0.816,0.92,1,0.7037,False,False
656
+ 655,symmetric_reflexion,55,planning,0.916,0.92,1,0.7091,False,False
657
+ 656,symmetric_reflexion,56,coding,0.859,0.93,1,0.7143,False,False
658
+ 657,symmetric_reflexion,57,research,0.772,0.86,1,0.7193,False,False
659
+ 658,symmetric_reflexion,58,analysis,0.805,0.93,1,0.7241,False,False
660
+ 659,symmetric_reflexion,59,planning,0.929,0.94,1,0.7288,False,False
661
+ 660,symmetric_reflexion,60,coding,0.831,0.16,0,0.7167,True,False
662
+ 661,symmetric_reflexion,61,research,0.776,0.24,0,0.7049,True,False
663
+ 662,symmetric_reflexion,62,analysis,0.73,0.88,1,0.7097,True,False
664
+ 663,symmetric_reflexion,63,planning,0.934,0.25,0,0.6984,True,False
665
+ 664,symmetric_reflexion,64,coding,0.763,0.21,0,0.6875,True,False
666
+ 665,symmetric_reflexion,65,research,0.766,0.15,0,0.6769,True,False
667
+ 666,symmetric_reflexion,66,analysis,0.722,0.85,1,0.6818,True,False
668
+ 667,symmetric_reflexion,67,planning,0.744,0.31,0,0.6716,True,False
669
+ 668,symmetric_reflexion,68,coding,0.846,0.21,0,0.6618,True,False
670
+ 669,symmetric_reflexion,69,research,0.925,0.17,0,0.6522,True,False
671
+ 670,symmetric_reflexion,70,analysis,0.856,0.89,1,0.6571,True,False
672
+ 671,symmetric_reflexion,71,planning,0.832,0.25,0,0.6479,True,False
673
+ 672,symmetric_reflexion,72,coding,0.874,0.18,0,0.6389,True,False
674
+ 673,symmetric_reflexion,73,research,0.78,0.23,0,0.6301,True,False
675
+ 674,symmetric_reflexion,74,analysis,0.81,0.29,0,0.6216,True,True
676
+ 675,symmetric_reflexion,75,planning,0.854,0.95,1,0.6267,True,False
677
+ 676,symmetric_reflexion,76,coding,0.93,0.15,0,0.6184,True,False
678
+ 677,symmetric_reflexion,77,research,0.86,0.88,1,0.6234,True,False
679
+ 678,symmetric_reflexion,78,analysis,0.733,0.29,0,0.6154,True,False
680
+ 679,symmetric_reflexion,79,planning,0.745,0.24,0,0.6076,True,False
681
+ 680,symmetric_reflexion,80,coding,0.801,0.9,1,0.6125,True,False
682
+ 681,symmetric_reflexion,81,research,0.885,0.86,1,0.6173,True,False
683
+ 682,symmetric_reflexion,82,analysis,0.798,0.28,0,0.6098,True,False
684
+ 683,symmetric_reflexion,83,planning,0.869,0.27,0,0.6024,True,False
685
+ 684,symmetric_reflexion,84,coding,0.722,0.33,0,0.5952,True,False
686
+ 685,symmetric_reflexion,85,research,0.855,0.29,0,0.5882,True,False
687
+ 686,symmetric_reflexion,86,analysis,0.747,0.16,0,0.5814,True,False
688
+ 687,symmetric_reflexion,87,planning,0.837,0.85,1,0.5862,True,False
689
+ 688,symmetric_reflexion,88,coding,0.813,0.91,1,0.5909,True,False
690
+ 689,symmetric_reflexion,89,research,0.847,0.86,1,0.5955,True,False
691
+ 690,symmetric_reflexion,90,analysis,0.843,0.3,0,0.5889,True,False
692
+ 691,symmetric_reflexion,91,planning,0.864,0.29,0,0.5824,True,False
693
+ 692,symmetric_reflexion,92,coding,0.815,0.21,0,0.5761,True,False
694
+ 693,symmetric_reflexion,93,research,0.787,0.24,0,0.5699,True,False
695
+ 694,symmetric_reflexion,94,analysis,0.896,0.32,0,0.5638,True,False
696
+ 695,symmetric_reflexion,95,planning,0.922,0.21,0,0.5579,True,True
697
+ 696,symmetric_reflexion,96,coding,0.848,0.92,1,0.5625,True,False
698
+ 697,symmetric_reflexion,97,research,0.875,0.22,0,0.5567,True,False
699
+ 698,symmetric_reflexion,98,analysis,0.757,0.18,0,0.551,True,False
700
+ 699,symmetric_reflexion,99,planning,0.916,0.18,0,0.5455,True,True
701
+ 700,symmetric_reflexion,100,coding,0.726,0.93,1,0.55,True,False
702
+ 701,symmetric_reflexion,101,research,0.795,0.9,1,0.5545,True,False
703
+ 702,symmetric_reflexion,102,analysis,0.788,0.27,0,0.549,True,False
704
+ 703,symmetric_reflexion,103,planning,0.8,0.97,1,0.5534,True,False
705
+ 704,symmetric_reflexion,104,coding,0.82,0.18,0,0.5481,True,False
706
+ 705,symmetric_reflexion,105,research,0.827,0.91,1,0.5524,True,False
707
+ 706,symmetric_reflexion,106,analysis,0.932,0.16,0,0.5472,True,False
708
+ 707,symmetric_reflexion,107,planning,0.727,0.18,0,0.5421,True,False
709
+ 708,symmetric_reflexion,108,coding,0.725,0.24,0,0.537,True,False
710
+ 709,symmetric_reflexion,109,research,0.784,0.17,0,0.5321,True,False
711
+ 710,symmetric_reflexion,110,analysis,0.93,0.33,0,0.5273,True,True
712
+ 711,symmetric_reflexion,111,planning,0.853,0.97,1,0.5315,True,False
713
+ 712,symmetric_reflexion,112,coding,0.783,0.23,0,0.5268,True,False
714
+ 713,symmetric_reflexion,113,research,0.805,0.26,0,0.5221,True,False
715
+ 714,symmetric_reflexion,114,analysis,0.754,0.26,0,0.5175,True,False
716
+ 715,symmetric_reflexion,115,planning,0.888,0.24,0,0.513,True,True
717
+ 716,symmetric_reflexion,116,coding,0.787,0.87,1,0.5172,True,False
718
+ 717,symmetric_reflexion,117,research,0.733,0.2,0,0.5128,True,False
719
+ 718,symmetric_reflexion,118,analysis,0.933,0.22,0,0.5085,True,False
720
+ 719,symmetric_reflexion,119,planning,0.848,0.9,1,0.5126,True,False
721
+ 720,symmetric_reflexion,120,coding,0.858,0.23,0,0.5083,True,False
722
+ 721,symmetric_reflexion,121,research,0.939,0.27,0,0.5041,True,False
723
+ 722,symmetric_reflexion,122,analysis,0.845,0.19,0,0.5,True,False
724
+ 723,symmetric_reflexion,123,planning,0.807,0.91,1,0.5041,True,False
725
+ 724,symmetric_reflexion,124,coding,0.839,0.97,1,0.5081,True,False
726
+ 725,symmetric_reflexion,125,research,0.92,0.26,0,0.504,True,False
727
+ 726,symmetric_reflexion,126,analysis,0.911,0.94,1,0.5079,True,False
728
+ 727,symmetric_reflexion,127,planning,0.747,0.21,0,0.5039,True,False
729
+ 728,symmetric_reflexion,128,coding,0.913,0.18,0,0.5,True,False
730
+ 729,symmetric_reflexion,129,research,0.822,0.25,0,0.4961,True,False
731
+ 730,symmetric_reflexion,130,analysis,0.91,0.23,0,0.4923,True,False
732
+ 731,symmetric_reflexion,131,planning,0.783,0.94,1,0.4962,True,False
733
+ 732,symmetric_reflexion,132,coding,0.805,0.25,0,0.4924,True,False
734
+ 733,symmetric_reflexion,133,research,0.847,0.35,0,0.4887,True,False
735
+ 734,symmetric_reflexion,134,analysis,0.81,0.3,0,0.4851,True,False
736
+ 735,symmetric_reflexion,135,planning,0.846,0.19,0,0.4815,True,False
737
+ 736,symmetric_reflexion,136,coding,0.744,0.24,0,0.4779,True,True
738
+ 737,symmetric_reflexion,137,research,0.906,0.16,0,0.4745,True,True
739
+ 738,symmetric_reflexion,138,analysis,0.914,0.91,1,0.4783,True,False
740
+ 739,symmetric_reflexion,139,planning,0.858,0.15,0,0.4748,True,False
741
+ 740,symmetric_reflexion,140,coding,0.825,0.29,0,0.4714,True,False
742
+ 741,symmetric_reflexion,141,research,0.872,0.89,1,0.4752,False,False
743
+ 742,symmetric_reflexion,142,analysis,0.799,0.88,1,0.4789,False,False
744
+ 743,symmetric_reflexion,143,planning,0.766,0.15,0,0.4755,False,False
745
+ 744,symmetric_reflexion,144,coding,0.94,0.95,1,0.4792,False,False
746
+ 745,symmetric_reflexion,145,research,0.785,0.94,1,0.4828,False,False
747
+ 746,symmetric_reflexion,146,analysis,0.904,0.87,1,0.4863,False,False
748
+ 747,symmetric_reflexion,147,planning,0.886,0.93,1,0.4898,False,False
749
+ 748,symmetric_reflexion,148,coding,0.889,0.27,0,0.4865,False,False
750
+ 749,symmetric_reflexion,149,research,0.739,0.86,1,0.4899,False,False
751
+ 750,symmetric_reflexion,150,analysis,0.81,0.86,1,0.4933,False,False
752
+ 751,symmetric_reflexion,151,planning,0.797,0.95,1,0.4967,False,False
753
+ 752,symmetric_reflexion,152,coding,0.928,0.96,1,0.5,False,False
754
+ 753,symmetric_reflexion,153,research,0.835,0.86,1,0.5033,False,False
755
+ 754,symmetric_reflexion,154,analysis,0.83,0.93,1,0.5065,False,False
756
+ 755,symmetric_reflexion,155,planning,0.731,0.9,1,0.5097,False,False
757
+ 756,symmetric_reflexion,156,coding,0.785,0.88,1,0.5128,False,False
758
+ 757,symmetric_reflexion,157,research,0.897,0.23,0,0.5096,False,False
759
+ 758,symmetric_reflexion,158,analysis,0.919,0.91,1,0.5127,False,False
760
+ 759,symmetric_reflexion,159,planning,0.77,0.97,1,0.5157,False,False
761
+ 760,symmetric_reflexion,160,coding,0.853,0.93,1,0.5188,False,False
762
+ 761,symmetric_reflexion,161,research,0.747,0.25,0,0.5155,False,False
763
+ 762,symmetric_reflexion,162,analysis,0.819,0.92,1,0.5185,False,False
764
+ 763,symmetric_reflexion,163,planning,0.736,0.88,1,0.5215,False,False
765
+ 764,symmetric_reflexion,164,coding,0.877,0.95,1,0.5244,False,False
766
+ 765,symmetric_reflexion,165,research,0.842,0.87,1,0.5273,False,False
767
+ 766,symmetric_reflexion,166,analysis,0.891,0.91,1,0.5301,False,False
768
+ 767,symmetric_reflexion,167,planning,0.783,0.93,1,0.5329,False,False
769
+ 768,symmetric_reflexion,168,coding,0.732,0.89,1,0.5357,False,False
770
+ 769,symmetric_reflexion,169,research,0.72,0.86,1,0.5385,False,False
771
+ 770,symmetric_reflexion,170,analysis,0.781,0.86,1,0.5412,False,False
772
+ 771,symmetric_reflexion,171,planning,0.905,0.88,1,0.5439,False,False
773
+ 772,symmetric_reflexion,172,coding,0.883,0.86,1,0.5465,False,False
774
+ 773,symmetric_reflexion,173,research,0.799,0.95,1,0.5491,False,False
775
+ 774,symmetric_reflexion,174,analysis,0.789,0.96,1,0.5517,False,False
776
+ 775,symmetric_reflexion,175,planning,0.815,0.23,0,0.5486,False,False
777
+ 776,symmetric_reflexion,176,coding,0.932,0.93,1,0.5511,False,False
778
+ 777,symmetric_reflexion,177,research,0.829,0.93,1,0.5537,False,False
779
+ 778,symmetric_reflexion,178,analysis,0.875,0.87,1,0.5562,False,False
780
+ 779,symmetric_reflexion,179,planning,0.877,0.97,1,0.5587,False,False
781
+ 780,symmetric_reflexion,180,coding,0.887,0.29,0,0.5556,False,False
782
+ 781,symmetric_reflexion,181,research,0.786,0.94,1,0.558,False,False
783
+ 782,symmetric_reflexion,182,analysis,0.862,0.89,1,0.5604,False,False
784
+ 783,symmetric_reflexion,183,planning,0.93,0.9,1,0.5628,False,False
785
+ 784,symmetric_reflexion,184,coding,0.821,0.89,1,0.5652,False,False
786
+ 785,symmetric_reflexion,185,research,0.801,0.94,1,0.5676,False,False
787
+ 786,symmetric_reflexion,186,analysis,0.812,0.95,1,0.5699,False,False
788
+ 787,symmetric_reflexion,187,planning,0.767,0.91,1,0.5722,False,False
789
+ 788,symmetric_reflexion,188,coding,0.914,0.93,1,0.5745,False,False
790
+ 789,symmetric_reflexion,189,research,0.854,0.87,1,0.5767,False,False
791
+ 790,symmetric_reflexion,190,analysis,0.863,0.89,1,0.5789,False,False
792
+ 791,symmetric_reflexion,191,planning,0.862,0.94,1,0.5812,False,False
793
+ 792,symmetric_reflexion,192,coding,0.764,0.21,0,0.5781,False,False
794
+ 793,symmetric_reflexion,193,research,0.801,0.86,1,0.5803,False,False
795
+ 794,symmetric_reflexion,194,analysis,0.833,0.95,1,0.5825,False,False
796
+ 795,symmetric_reflexion,195,planning,0.723,0.89,1,0.5846,False,False
797
+ 796,symmetric_reflexion,196,coding,0.724,0.9,1,0.5867,False,False
798
+ 797,symmetric_reflexion,197,research,0.828,0.91,1,0.5888,False,False
799
+ 798,symmetric_reflexion,198,analysis,0.851,0.91,1,0.5909,False,False
800
+ 799,symmetric_reflexion,199,planning,0.932,0.93,1,0.593,False,False
801
+ 800,symmetric_reflexion,200,coding,0.789,0.94,1,0.595,False,False
802
+ 801,symmetric_reflexion,201,research,0.835,0.18,0,0.592,False,False
803
+ 802,symmetric_reflexion,202,analysis,0.724,0.95,1,0.5941,False,False
804
+ 803,symmetric_reflexion,203,planning,0.746,0.85,1,0.5961,False,False
805
+ 804,symmetric_reflexion,204,coding,0.785,0.91,1,0.598,False,False
806
+ 805,symmetric_reflexion,205,research,0.797,0.85,1,0.6,False,False
807
+ 806,symmetric_reflexion,206,analysis,0.786,0.97,1,0.6019,False,False
808
+ 807,symmetric_reflexion,207,planning,0.906,0.96,1,0.6039,False,False
809
+ 808,symmetric_reflexion,208,coding,0.892,0.9,1,0.6058,False,False
810
+ 809,symmetric_reflexion,209,research,0.808,0.86,1,0.6077,False,False
811
+ 810,symmetric_reflexion,210,analysis,0.77,0.91,1,0.6095,False,False
812
+ 811,symmetric_reflexion,211,planning,0.884,0.86,1,0.6114,False,False
813
+ 812,symmetric_reflexion,212,coding,0.931,0.31,0,0.6085,False,False
814
+ 813,symmetric_reflexion,213,research,0.938,0.97,1,0.6103,False,False
815
+ 814,symmetric_reflexion,214,analysis,0.737,0.88,1,0.6121,False,False
816
+ 815,symmetric_reflexion,215,planning,0.763,0.92,1,0.614,False,False
817
+ 816,symmetric_reflexion,216,coding,0.892,0.87,1,0.6157,False,False
818
+ 817,symmetric_reflexion,217,research,0.898,0.9,1,0.6175,False,False
819
+ 818,symmetric_reflexion,218,analysis,0.868,0.89,1,0.6193,False,False
820
+ 819,symmetric_reflexion,219,planning,0.922,0.91,1,0.621,False,False
821
+ 820,symmetric_reflexion,220,coding,0.916,0.86,1,0.6227,False,False
822
+ 821,symmetric_reflexion,221,research,0.752,0.93,1,0.6244,False,False
823
+ 822,symmetric_reflexion,222,analysis,0.818,0.96,1,0.6261,False,False
824
+ 823,symmetric_reflexion,223,planning,0.837,0.91,1,0.6278,False,False
825
+ 824,symmetric_reflexion,224,coding,0.87,0.88,1,0.6295,False,False
826
+ 825,symmetric_reflexion,225,research,0.898,0.92,1,0.6311,False,False
827
+ 826,symmetric_reflexion,226,analysis,0.815,0.87,1,0.6327,False,False
828
+ 827,symmetric_reflexion,227,planning,0.818,0.86,1,0.6344,False,False
829
+ 828,symmetric_reflexion,228,coding,0.906,0.31,0,0.6316,False,False
830
+ 829,symmetric_reflexion,229,research,0.908,0.97,1,0.6332,False,False
831
+ 830,symmetric_reflexion,230,analysis,0.763,0.35,0,0.6304,False,False
832
+ 831,symmetric_reflexion,231,planning,0.877,0.26,0,0.6277,False,False
833
+ 832,symmetric_reflexion,232,coding,0.777,0.92,1,0.6293,False,False
834
+ 833,symmetric_reflexion,233,research,0.736,0.97,1,0.6309,False,False
835
+ 834,symmetric_reflexion,234,analysis,0.762,0.96,1,0.6325,False,False
836
+ 835,symmetric_reflexion,235,planning,0.928,0.25,0,0.6298,False,False
837
+ 836,symmetric_reflexion,236,coding,0.935,0.87,1,0.6314,False,False
838
+ 837,symmetric_reflexion,237,research,0.825,0.88,1,0.6329,False,False
839
+ 838,symmetric_reflexion,238,analysis,0.861,0.87,1,0.6345,False,False
840
+ 839,symmetric_reflexion,239,planning,0.844,0.91,1,0.636,False,False
841
+ 840,symmetric_reflexion,240,coding,0.723,0.89,1,0.6375,False,False
842
+ 841,symmetric_reflexion,241,research,0.924,0.93,1,0.639,False,False
843
+ 842,symmetric_reflexion,242,analysis,0.769,0.95,1,0.6405,False,False
844
+ 843,symmetric_reflexion,243,planning,0.88,0.9,1,0.642,False,False
845
+ 844,symmetric_reflexion,244,coding,0.726,0.93,1,0.6434,False,False
846
+ 845,symmetric_reflexion,245,research,0.746,0.9,1,0.6449,False,False
847
+ 846,symmetric_reflexion,246,analysis,0.922,0.16,0,0.6423,False,False
848
+ 847,symmetric_reflexion,247,planning,0.887,0.9,1,0.6437,False,False
849
+ 848,symmetric_reflexion,248,coding,0.886,0.34,0,0.6411,False,False
850
+ 849,symmetric_reflexion,249,research,0.847,0.94,1,0.6426,False,False
851
+ 850,symmetric_reflexion,250,analysis,0.775,0.89,1,0.644,False,False
852
+ 851,symmetric_reflexion,251,planning,0.864,0.87,1,0.6454,False,False
853
+ 852,symmetric_reflexion,252,coding,0.922,0.91,1,0.6468,False,False
854
+ 853,symmetric_reflexion,253,research,0.769,0.85,1,0.6482,False,False
855
+ 854,symmetric_reflexion,254,analysis,0.759,0.21,0,0.6457,False,False
856
+ 855,symmetric_reflexion,255,planning,0.929,0.9,1,0.6471,False,False
857
+ 856,symmetric_reflexion,256,coding,0.848,0.94,1,0.6484,False,False
858
+ 857,symmetric_reflexion,257,research,0.782,0.96,1,0.6498,False,False
859
+ 858,symmetric_reflexion,258,analysis,0.928,0.23,0,0.6473,False,False
860
+ 859,symmetric_reflexion,259,planning,0.892,0.91,1,0.6486,False,False
861
+ 860,symmetric_reflexion,260,coding,0.765,0.87,1,0.65,False,False
862
+ 861,symmetric_reflexion,261,research,0.793,0.19,0,0.6475,False,False
863
+ 862,symmetric_reflexion,262,analysis,0.736,0.96,1,0.6489,False,False
864
+ 863,symmetric_reflexion,263,planning,0.832,0.95,1,0.6502,False,False
865
+ 864,symmetric_reflexion,264,coding,0.904,0.93,1,0.6515,False,False
866
+ 865,symmetric_reflexion,265,research,0.89,0.87,1,0.6528,False,False
867
+ 866,symmetric_reflexion,266,analysis,0.913,0.88,1,0.6541,False,False
868
+ 867,symmetric_reflexion,267,planning,0.814,0.87,1,0.6554,False,False
869
+ 868,symmetric_reflexion,268,coding,0.888,0.9,1,0.6567,False,False
870
+ 869,symmetric_reflexion,269,research,0.835,0.97,1,0.658,False,False
871
+ 870,symmetric_reflexion,270,analysis,0.77,0.89,1,0.6593,False,False
872
+ 871,symmetric_reflexion,271,planning,0.771,0.94,1,0.6605,False,False
873
+ 872,symmetric_reflexion,272,coding,0.933,0.93,1,0.6618,False,False
874
+ 873,symmetric_reflexion,273,research,0.883,0.23,0,0.6593,False,False
875
+ 874,symmetric_reflexion,274,analysis,0.787,0.94,1,0.6606,False,False
876
+ 875,symmetric_reflexion,275,planning,0.9,0.89,1,0.6618,False,False
877
+ 876,symmetric_reflexion,276,coding,0.918,0.97,1,0.663,False,False
878
+ 877,symmetric_reflexion,277,research,0.886,0.92,1,0.6643,False,False
879
+ 878,symmetric_reflexion,278,analysis,0.865,0.92,1,0.6655,False,False
880
+ 879,symmetric_reflexion,279,planning,0.876,0.94,1,0.6667,False,False
881
+ 880,symmetric_reflexion,280,coding,0.848,0.16,0,0.6643,False,False
882
+ 881,symmetric_reflexion,281,research,0.778,0.89,1,0.6655,False,False
883
+ 882,symmetric_reflexion,282,analysis,0.877,0.86,1,0.6667,False,False
884
+ 883,symmetric_reflexion,283,planning,0.833,0.89,1,0.6678,False,False
885
+ 884,symmetric_reflexion,284,coding,0.925,0.93,1,0.669,False,False
886
+ 885,symmetric_reflexion,285,research,0.877,0.96,1,0.6702,False,False
887
+ 886,symmetric_reflexion,286,analysis,0.873,0.95,1,0.6713,False,False
888
+ 887,symmetric_reflexion,287,planning,0.78,0.87,1,0.6725,False,False
889
+ 888,symmetric_reflexion,288,coding,0.796,0.97,1,0.6736,False,False
890
+ 889,symmetric_reflexion,289,research,0.908,0.94,1,0.6747,False,False
891
+ 890,symmetric_reflexion,290,analysis,0.844,0.25,0,0.6724,False,False
892
+ 891,symmetric_reflexion,291,planning,0.804,0.94,1,0.6735,False,False
893
+ 892,symmetric_reflexion,292,coding,0.882,0.85,1,0.6747,False,False
894
+ 893,symmetric_reflexion,293,research,0.905,0.93,1,0.6758,False,False
895
+ 894,symmetric_reflexion,294,analysis,0.933,0.88,1,0.6769,False,False
896
+ 895,symmetric_reflexion,295,planning,0.875,0.92,1,0.678,False,False
897
+ 896,symmetric_reflexion,296,coding,0.933,0.91,1,0.6791,False,False
898
+ 897,symmetric_reflexion,297,research,0.878,0.19,0,0.6768,False,False
899
+ 898,symmetric_reflexion,298,analysis,0.896,0.9,1,0.6779,False,False
900
+ 899,symmetric_reflexion,299,planning,0.749,0.18,0,0.6756,False,False
901
+ 900,symmetric_reflexion,300,coding,0.788,0.95,1,0.6767,False,False
902
+ 901,adaptive_bayesian_lcb,1,research,0.868,0.88,1,1.0,False,False
903
+ 902,adaptive_bayesian_lcb,2,analysis,0.857,0.95,1,1.0,False,False
904
+ 903,adaptive_bayesian_lcb,3,planning,0.919,0.93,1,1.0,False,False
905
+ 904,adaptive_bayesian_lcb,4,coding,0.731,0.88,1,1.0,False,False
906
+ 905,adaptive_bayesian_lcb,5,research,0.787,0.92,1,1.0,False,False
907
+ 906,adaptive_bayesian_lcb,6,analysis,0.793,0.9,1,1.0,False,False
908
+ 907,adaptive_bayesian_lcb,7,planning,0.735,0.88,1,1.0,False,False
909
+ 908,adaptive_bayesian_lcb,8,coding,0.815,0.89,1,1.0,False,False
910
+ 909,adaptive_bayesian_lcb,9,research,0.732,0.96,1,1.0,False,False
911
+ 910,adaptive_bayesian_lcb,10,analysis,0.861,0.93,1,1.0,False,False
912
+ 911,adaptive_bayesian_lcb,11,planning,0.764,0.94,1,1.0,False,False
913
+ 912,adaptive_bayesian_lcb,12,coding,0.742,0.88,1,1.0,False,False
914
+ 913,adaptive_bayesian_lcb,13,research,0.815,0.16,0,0.9231,False,False
915
+ 914,adaptive_bayesian_lcb,14,analysis,0.834,0.97,1,0.9286,False,False
916
+ 915,adaptive_bayesian_lcb,15,planning,0.745,0.94,1,0.9333,False,False
917
+ 916,adaptive_bayesian_lcb,16,coding,0.875,0.89,1,0.9375,False,False
918
+ 917,adaptive_bayesian_lcb,17,research,0.807,0.87,1,0.9412,False,False
919
+ 918,adaptive_bayesian_lcb,18,analysis,0.826,0.88,1,0.9444,False,False
920
+ 919,adaptive_bayesian_lcb,19,planning,0.864,0.27,0,0.8947,False,False
921
+ 920,adaptive_bayesian_lcb,20,coding,0.737,0.96,1,0.9,False,False
922
+ 921,adaptive_bayesian_lcb,21,research,0.785,0.92,1,0.9048,False,False
923
+ 922,adaptive_bayesian_lcb,22,analysis,0.857,0.88,1,0.9091,False,False
924
+ 923,adaptive_bayesian_lcb,23,planning,0.723,0.2,0,0.8696,False,False
925
+ 924,adaptive_bayesian_lcb,24,coding,0.869,0.92,1,0.875,False,False
926
+ 925,adaptive_bayesian_lcb,25,research,0.789,0.92,1,0.88,False,False
927
+ 926,adaptive_bayesian_lcb,26,analysis,0.911,0.17,0,0.8462,False,False
928
+ 927,adaptive_bayesian_lcb,27,planning,0.754,0.3,0,0.8148,False,False
929
+ 928,adaptive_bayesian_lcb,28,coding,0.914,0.92,1,0.8214,False,False
930
+ 929,adaptive_bayesian_lcb,29,research,0.874,0.9,1,0.8276,False,False
931
+ 930,adaptive_bayesian_lcb,30,analysis,0.723,0.88,1,0.8333,False,False
932
+ 931,adaptive_bayesian_lcb,31,planning,0.819,0.23,0,0.8065,False,False
933
+ 932,adaptive_bayesian_lcb,32,coding,0.905,0.93,1,0.8125,False,False
934
+ 933,adaptive_bayesian_lcb,33,research,0.935,0.85,1,0.8182,False,False
935
+ 934,adaptive_bayesian_lcb,34,analysis,0.815,0.94,1,0.8235,False,False
936
+ 935,adaptive_bayesian_lcb,35,planning,0.921,0.88,1,0.8286,False,False
937
+ 936,adaptive_bayesian_lcb,36,coding,0.816,0.85,1,0.8333,False,False
938
+ 937,adaptive_bayesian_lcb,37,research,0.85,0.93,1,0.8378,False,False
939
+ 938,adaptive_bayesian_lcb,38,analysis,0.773,0.86,1,0.8421,False,False
940
+ 939,adaptive_bayesian_lcb,39,planning,0.764,0.94,1,0.8462,False,False
941
+ 940,adaptive_bayesian_lcb,40,coding,0.723,0.88,1,0.85,False,False
942
+ 941,adaptive_bayesian_lcb,41,research,0.78,0.86,1,0.8537,False,False
943
+ 942,adaptive_bayesian_lcb,42,analysis,0.821,0.92,1,0.8571,False,False
944
+ 943,adaptive_bayesian_lcb,43,planning,0.868,0.96,1,0.8605,False,False
945
+ 944,adaptive_bayesian_lcb,44,coding,0.904,0.95,1,0.8636,False,False
946
+ 945,adaptive_bayesian_lcb,45,research,0.925,0.87,1,0.8667,False,False
947
+ 946,adaptive_bayesian_lcb,46,analysis,0.856,0.94,1,0.8696,False,False
948
+ 947,adaptive_bayesian_lcb,47,planning,0.835,0.89,1,0.8723,False,False
949
+ 948,adaptive_bayesian_lcb,48,coding,0.923,0.91,1,0.875,False,False
950
+ 949,adaptive_bayesian_lcb,49,research,0.779,0.96,1,0.8776,False,False
951
+ 950,adaptive_bayesian_lcb,50,analysis,0.867,0.9,1,0.88,False,False
952
+ 951,adaptive_bayesian_lcb,51,planning,0.859,0.93,1,0.8824,False,False
953
+ 952,adaptive_bayesian_lcb,52,coding,0.814,0.93,1,0.8846,False,False
954
+ 953,adaptive_bayesian_lcb,53,research,0.926,0.95,1,0.8868,False,False
955
+ 954,adaptive_bayesian_lcb,54,analysis,0.784,0.85,1,0.8889,False,False
956
+ 955,adaptive_bayesian_lcb,55,planning,0.786,0.86,1,0.8909,False,False
957
+ 956,adaptive_bayesian_lcb,56,coding,0.828,0.17,0,0.875,False,False
958
+ 957,adaptive_bayesian_lcb,57,research,0.888,0.93,1,0.8772,False,False
959
+ 958,adaptive_bayesian_lcb,58,analysis,0.777,0.87,1,0.8793,False,False
960
+ 959,adaptive_bayesian_lcb,59,planning,0.736,0.93,1,0.8814,False,False
961
+ 960,adaptive_bayesian_lcb,60,coding,0.914,0.29,0,0.8667,True,False
962
+ 961,adaptive_bayesian_lcb,61,research,0.744,0.89,1,0.8689,True,False
963
+ 962,adaptive_bayesian_lcb,62,analysis,0.775,0.26,0,0.8548,True,False
964
+ 963,adaptive_bayesian_lcb,63,planning,0.799,0.32,0,0.8413,True,False
965
+ 964,adaptive_bayesian_lcb,64,coding,0.894,0.33,0,0.8281,True,False
966
+ 965,adaptive_bayesian_lcb,65,research,0.93,0.22,0,0.8154,True,False
967
+ 966,adaptive_bayesian_lcb,66,analysis,0.831,0.33,0,0.803,True,False
968
+ 967,adaptive_bayesian_lcb,67,planning,0.743,0.26,0,0.791,True,False
969
+ 968,adaptive_bayesian_lcb,68,coding,0.831,0.95,1,0.7941,True,False
970
+ 969,adaptive_bayesian_lcb,69,research,0.869,0.32,0,0.7826,True,False
971
+ 970,adaptive_bayesian_lcb,70,analysis,0.885,0.27,0,0.7714,True,False
972
+ 971,adaptive_bayesian_lcb,71,planning,0.755,0.19,0,0.7606,True,False
973
+ 972,adaptive_bayesian_lcb,72,coding,0.873,0.86,1,0.7639,True,False
974
+ 973,adaptive_bayesian_lcb,73,research,0.756,0.94,1,0.7671,True,False
975
+ 974,adaptive_bayesian_lcb,74,analysis,0.881,0.18,0,0.7568,True,False
976
+ 975,adaptive_bayesian_lcb,75,planning,0.738,0.87,1,0.76,True,False
977
+ 976,adaptive_bayesian_lcb,76,coding,0.916,0.89,1,0.7632,True,False
978
+ 977,adaptive_bayesian_lcb,77,research,0.743,0.91,1,0.7662,True,False
979
+ 978,adaptive_bayesian_lcb,78,analysis,0.854,0.86,1,0.7692,True,False
980
+ 979,adaptive_bayesian_lcb,79,planning,0.806,0.88,1,0.7722,True,False
981
+ 980,adaptive_bayesian_lcb,80,coding,0.931,0.26,0,0.7625,True,False
982
+ 981,adaptive_bayesian_lcb,81,research,0.811,0.26,0,0.7531,True,False
983
+ 982,adaptive_bayesian_lcb,82,analysis,0.873,0.18,0,0.7439,True,False
984
+ 983,adaptive_bayesian_lcb,83,planning,0.83,0.32,0,0.7349,True,False
985
+ 984,adaptive_bayesian_lcb,84,coding,0.859,0.17,0,0.7262,True,False
986
+ 985,adaptive_bayesian_lcb,85,research,0.853,0.89,1,0.7294,True,False
987
+ 986,adaptive_bayesian_lcb,86,analysis,0.751,0.19,0,0.7209,True,False
988
+ 987,adaptive_bayesian_lcb,87,planning,0.806,0.19,0,0.7126,True,False
989
+ 988,adaptive_bayesian_lcb,88,coding,0.832,0.15,0,0.7045,True,False
990
+ 989,adaptive_bayesian_lcb,89,research,0.894,0.91,1,0.7079,True,False
991
+ 990,adaptive_bayesian_lcb,90,analysis,0.843,0.29,0,0.7,True,False
992
+ 991,adaptive_bayesian_lcb,91,planning,0.776,0.94,1,0.7033,True,False
993
+ 992,adaptive_bayesian_lcb,92,coding,0.838,0.31,0,0.6957,True,False
994
+ 993,adaptive_bayesian_lcb,93,research,0.906,0.22,0,0.6882,True,False
995
+ 994,adaptive_bayesian_lcb,94,analysis,0.894,0.19,0,0.6809,True,False
996
+ 995,adaptive_bayesian_lcb,95,planning,0.908,0.24,0,0.6737,True,False
997
+ 996,adaptive_bayesian_lcb,96,coding,0.737,0.31,0,0.6667,True,False
998
+ 997,adaptive_bayesian_lcb,97,research,0.918,0.86,1,0.6701,True,False
999
+ 998,adaptive_bayesian_lcb,98,analysis,0.913,0.26,0,0.6633,True,False
1000
+ 999,adaptive_bayesian_lcb,99,planning,0.933,0.93,1,0.6667,True,False
1001
+ 1000,adaptive_bayesian_lcb,100,coding,0.736,0.31,0,0.66,True,False
1002
+ 1001,adaptive_bayesian_lcb,101,research,0.815,0.26,0,0.6535,True,False
1003
+ 1002,adaptive_bayesian_lcb,102,analysis,0.791,0.89,1,0.6569,True,False
1004
+ 1003,adaptive_bayesian_lcb,103,planning,0.802,0.89,1,0.6602,True,False
1005
+ 1004,adaptive_bayesian_lcb,104,coding,0.822,0.28,0,0.6538,True,False
1006
+ 1005,adaptive_bayesian_lcb,105,research,0.876,0.88,1,0.6571,True,False
1007
+ 1006,adaptive_bayesian_lcb,106,analysis,0.866,0.15,0,0.6509,True,False
1008
+ 1007,adaptive_bayesian_lcb,107,planning,0.897,0.26,0,0.6449,True,False
1009
+ 1008,adaptive_bayesian_lcb,108,coding,0.735,0.27,0,0.6389,True,False
1010
+ 1009,adaptive_bayesian_lcb,109,research,0.892,0.31,0,0.633,True,False
1011
+ 1010,adaptive_bayesian_lcb,110,analysis,0.834,0.93,1,0.6364,True,False
1012
+ 1011,adaptive_bayesian_lcb,111,planning,0.857,0.18,0,0.6306,True,False
1013
+ 1012,adaptive_bayesian_lcb,112,coding,0.763,0.3,0,0.625,True,False
1014
+ 1013,adaptive_bayesian_lcb,113,research,0.92,0.27,0,0.6195,True,True
1015
+ 1014,adaptive_bayesian_lcb,114,analysis,0.864,0.27,0,0.614,True,True
1016
+ 1015,adaptive_bayesian_lcb,115,planning,0.859,0.91,1,0.6174,True,True
1017
+ 1016,adaptive_bayesian_lcb,116,coding,0.878,0.87,1,0.6207,True,True
1018
+ 1017,adaptive_bayesian_lcb,117,research,0.789,0.88,1,0.6239,True,True
1019
+ 1018,adaptive_bayesian_lcb,118,analysis,0.813,0.25,0,0.6186,True,True
1020
+ 1019,adaptive_bayesian_lcb,119,planning,0.761,0.93,1,0.6218,True,True
1021
+ 1020,adaptive_bayesian_lcb,120,coding,0.804,0.93,1,0.625,True,True
1022
+ 1021,adaptive_bayesian_lcb,121,research,0.895,0.93,1,0.6281,True,True
1023
+ 1022,adaptive_bayesian_lcb,122,analysis,0.778,0.28,0,0.623,True,True
1024
+ 1023,adaptive_bayesian_lcb,123,planning,0.791,0.87,1,0.626,True,True
1025
+ 1024,adaptive_bayesian_lcb,124,coding,0.873,0.92,1,0.629,True,True
1026
+ 1025,adaptive_bayesian_lcb,125,research,0.778,0.95,1,0.632,True,True
1027
+ 1026,adaptive_bayesian_lcb,126,analysis,0.891,0.87,1,0.6349,True,True
1028
+ 1027,adaptive_bayesian_lcb,127,planning,0.739,0.89,1,0.6378,True,True
1029
+ 1028,adaptive_bayesian_lcb,128,coding,0.815,0.88,1,0.6406,True,True
1030
+ 1029,adaptive_bayesian_lcb,129,research,0.727,0.88,1,0.6434,True,True
1031
+ 1030,adaptive_bayesian_lcb,130,analysis,0.843,0.93,1,0.6462,True,True
1032
+ 1031,adaptive_bayesian_lcb,131,planning,0.791,0.33,0,0.6412,True,True
1033
+ 1032,adaptive_bayesian_lcb,132,coding,0.792,0.35,0,0.6364,True,True
1034
+ 1033,adaptive_bayesian_lcb,133,research,0.902,0.88,1,0.6391,True,True
1035
+ 1034,adaptive_bayesian_lcb,134,analysis,0.847,0.86,1,0.6418,True,True
1036
+ 1035,adaptive_bayesian_lcb,135,planning,0.94,0.94,1,0.6444,True,True
1037
+ 1036,adaptive_bayesian_lcb,136,coding,0.897,0.97,1,0.6471,True,True
1038
+ 1037,adaptive_bayesian_lcb,137,research,0.773,0.9,1,0.6496,True,True
1039
+ 1038,adaptive_bayesian_lcb,138,analysis,0.749,0.89,1,0.6522,True,True
1040
+ 1039,adaptive_bayesian_lcb,139,planning,0.892,0.89,1,0.6547,True,True
1041
+ 1040,adaptive_bayesian_lcb,140,coding,0.864,0.85,1,0.6571,True,True
1042
+ 1041,adaptive_bayesian_lcb,141,research,0.888,0.94,1,0.6596,False,True
1043
+ 1042,adaptive_bayesian_lcb,142,analysis,0.729,0.92,1,0.662,False,True
1044
+ 1043,adaptive_bayesian_lcb,143,planning,0.844,0.95,1,0.6643,False,True
1045
+ 1044,adaptive_bayesian_lcb,144,coding,0.849,0.97,1,0.6667,False,True
1046
+ 1045,adaptive_bayesian_lcb,145,research,0.886,0.93,1,0.669,False,True
1047
+ 1046,adaptive_bayesian_lcb,146,analysis,0.806,0.92,1,0.6712,False,True
1048
+ 1047,adaptive_bayesian_lcb,147,planning,0.924,0.22,0,0.6667,False,True
1049
+ 1048,adaptive_bayesian_lcb,148,coding,0.836,0.97,1,0.6689,False,True
1050
+ 1049,adaptive_bayesian_lcb,149,research,0.936,0.95,1,0.6711,False,True
1051
+ 1050,adaptive_bayesian_lcb,150,analysis,0.877,0.86,1,0.6733,False,True
1052
+ 1051,adaptive_bayesian_lcb,151,planning,0.82,0.93,1,0.6755,False,True
1053
+ 1052,adaptive_bayesian_lcb,152,coding,0.802,0.18,0,0.6711,False,True
1054
+ 1053,adaptive_bayesian_lcb,153,research,0.83,0.93,1,0.6732,False,True
1055
+ 1054,adaptive_bayesian_lcb,154,analysis,0.863,0.87,1,0.6753,False,True
1056
+ 1055,adaptive_bayesian_lcb,155,planning,0.86,0.87,1,0.6774,False,True
1057
+ 1056,adaptive_bayesian_lcb,156,coding,0.875,0.93,1,0.6795,False,True
1058
+ 1057,adaptive_bayesian_lcb,157,research,0.904,0.85,1,0.6815,False,True
1059
+ 1058,adaptive_bayesian_lcb,158,analysis,0.891,0.93,1,0.6835,False,True
1060
+ 1059,adaptive_bayesian_lcb,159,planning,0.904,0.97,1,0.6855,False,True
1061
+ 1060,adaptive_bayesian_lcb,160,coding,0.838,0.9,1,0.6875,False,True
1062
+ 1061,adaptive_bayesian_lcb,161,research,0.754,0.88,1,0.6894,False,True
1063
+ 1062,adaptive_bayesian_lcb,162,analysis,0.923,0.92,1,0.6914,False,True
1064
+ 1063,adaptive_bayesian_lcb,163,planning,0.798,0.85,1,0.6933,False,True
1065
+ 1064,adaptive_bayesian_lcb,164,coding,0.813,0.92,1,0.6951,False,True
1066
+ 1065,adaptive_bayesian_lcb,165,research,0.914,0.28,0,0.6909,False,True
1067
+ 1066,adaptive_bayesian_lcb,166,analysis,0.766,0.96,1,0.6928,False,True
1068
+ 1067,adaptive_bayesian_lcb,167,planning,0.763,0.88,1,0.6946,False,True
1069
+ 1068,adaptive_bayesian_lcb,168,coding,0.897,0.16,0,0.6905,False,True
1070
+ 1069,adaptive_bayesian_lcb,169,research,0.917,0.97,1,0.6923,False,True
1071
+ 1070,adaptive_bayesian_lcb,170,analysis,0.822,0.86,1,0.6941,False,True
1072
+ 1071,adaptive_bayesian_lcb,171,planning,0.794,0.97,1,0.6959,False,True
1073
+ 1072,adaptive_bayesian_lcb,172,coding,0.9,0.96,1,0.6977,False,True
1074
+ 1073,adaptive_bayesian_lcb,173,research,0.739,0.86,1,0.6994,False,True
1075
+ 1074,adaptive_bayesian_lcb,174,analysis,0.766,0.91,1,0.7011,False,True
1076
+ 1075,adaptive_bayesian_lcb,175,planning,0.779,0.87,1,0.7029,False,True
1077
+ 1076,adaptive_bayesian_lcb,176,coding,0.752,0.3,0,0.6989,False,True
1078
+ 1077,adaptive_bayesian_lcb,177,research,0.933,0.88,1,0.7006,False,True
1079
+ 1078,adaptive_bayesian_lcb,178,analysis,0.896,0.89,1,0.7022,False,True
1080
+ 1079,adaptive_bayesian_lcb,179,planning,0.771,0.88,1,0.7039,False,True
1081
+ 1080,adaptive_bayesian_lcb,180,coding,0.798,0.86,1,0.7056,False,True
1082
+ 1081,adaptive_bayesian_lcb,181,research,0.766,0.87,1,0.7072,False,True
1083
+ 1082,adaptive_bayesian_lcb,182,analysis,0.795,0.87,1,0.7088,False,True
1084
+ 1083,adaptive_bayesian_lcb,183,planning,0.738,0.89,1,0.7104,False,True
1085
+ 1084,adaptive_bayesian_lcb,184,coding,0.844,0.87,1,0.712,False,True
1086
+ 1085,adaptive_bayesian_lcb,185,research,0.848,0.87,1,0.7135,False,True
1087
+ 1086,adaptive_bayesian_lcb,186,analysis,0.857,0.91,1,0.7151,False,True
1088
+ 1087,adaptive_bayesian_lcb,187,planning,0.738,0.89,1,0.7166,False,True
1089
+ 1088,adaptive_bayesian_lcb,188,coding,0.901,0.9,1,0.7181,False,True
1090
+ 1089,adaptive_bayesian_lcb,189,research,0.821,0.92,1,0.7196,False,True
1091
+ 1090,adaptive_bayesian_lcb,190,analysis,0.867,0.95,1,0.7211,False,True
1092
+ 1091,adaptive_bayesian_lcb,191,planning,0.789,0.95,1,0.7225,False,True
1093
+ 1092,adaptive_bayesian_lcb,192,coding,0.938,0.22,0,0.7188,False,True
1094
+ 1093,adaptive_bayesian_lcb,193,research,0.763,0.94,1,0.7202,False,True
1095
+ 1094,adaptive_bayesian_lcb,194,analysis,0.828,0.95,1,0.7216,False,True
1096
+ 1095,adaptive_bayesian_lcb,195,planning,0.8,0.9,1,0.7231,False,True
1097
+ 1096,adaptive_bayesian_lcb,196,coding,0.792,0.94,1,0.7245,False,True
1098
+ 1097,adaptive_bayesian_lcb,197,research,0.748,0.96,1,0.7259,False,True
1099
+ 1098,adaptive_bayesian_lcb,198,analysis,0.759,0.92,1,0.7273,False,True
1100
+ 1099,adaptive_bayesian_lcb,199,planning,0.828,0.88,1,0.7286,False,True
1101
+ 1100,adaptive_bayesian_lcb,200,coding,0.842,0.93,1,0.73,False,True
1102
+ 1101,adaptive_bayesian_lcb,201,research,0.751,0.87,1,0.7313,False,True
1103
+ 1102,adaptive_bayesian_lcb,202,analysis,0.781,0.87,1,0.7327,False,True
1104
+ 1103,adaptive_bayesian_lcb,203,planning,0.902,0.96,1,0.734,False,True
1105
+ 1104,adaptive_bayesian_lcb,204,coding,0.933,0.87,1,0.7353,False,True
1106
+ 1105,adaptive_bayesian_lcb,205,research,0.802,0.89,1,0.7366,False,True
1107
+ 1106,adaptive_bayesian_lcb,206,analysis,0.739,0.95,1,0.7379,False,True
1108
+ 1107,adaptive_bayesian_lcb,207,planning,0.895,0.93,1,0.7391,False,True
1109
+ 1108,adaptive_bayesian_lcb,208,coding,0.769,0.95,1,0.7404,False,True
1110
+ 1109,adaptive_bayesian_lcb,209,research,0.775,0.85,1,0.7416,False,True
1111
+ 1110,adaptive_bayesian_lcb,210,analysis,0.912,0.93,1,0.7429,False,True
1112
+ 1111,adaptive_bayesian_lcb,211,planning,0.885,0.9,1,0.7441,False,True
1113
+ 1112,adaptive_bayesian_lcb,212,coding,0.797,0.91,1,0.7453,False,True
1114
+ 1113,adaptive_bayesian_lcb,213,research,0.923,0.88,1,0.7465,False,True
1115
+ 1114,adaptive_bayesian_lcb,214,analysis,0.766,0.96,1,0.7477,False,True
1116
+ 1115,adaptive_bayesian_lcb,215,planning,0.823,0.94,1,0.7488,False,True
1117
+ 1116,adaptive_bayesian_lcb,216,coding,0.754,0.9,1,0.75,False,True
1118
+ 1117,adaptive_bayesian_lcb,217,research,0.851,0.3,0,0.7465,False,True
1119
+ 1118,adaptive_bayesian_lcb,218,analysis,0.808,0.87,1,0.7477,False,True
1120
+ 1119,adaptive_bayesian_lcb,219,planning,0.727,0.89,1,0.7489,False,True
1121
+ 1120,adaptive_bayesian_lcb,220,coding,0.832,0.96,1,0.75,False,True
1122
+ 1121,adaptive_bayesian_lcb,221,research,0.832,0.86,1,0.7511,False,True
1123
+ 1122,adaptive_bayesian_lcb,222,analysis,0.728,0.9,1,0.7523,False,True
1124
+ 1123,adaptive_bayesian_lcb,223,planning,0.905,0.85,1,0.7534,False,True
1125
+ 1124,adaptive_bayesian_lcb,224,coding,0.819,0.86,1,0.7545,False,True
1126
+ 1125,adaptive_bayesian_lcb,225,research,0.879,0.92,1,0.7556,False,True
1127
+ 1126,adaptive_bayesian_lcb,226,analysis,0.782,0.9,1,0.7566,False,True
1128
+ 1127,adaptive_bayesian_lcb,227,planning,0.896,0.94,1,0.7577,False,True
1129
+ 1128,adaptive_bayesian_lcb,228,coding,0.748,0.88,1,0.7588,False,True
1130
+ 1129,adaptive_bayesian_lcb,229,research,0.869,0.96,1,0.7598,False,True
1131
+ 1130,adaptive_bayesian_lcb,230,analysis,0.805,0.85,1,0.7609,False,True
1132
+ 1131,adaptive_bayesian_lcb,231,planning,0.902,0.94,1,0.7619,False,True
1133
+ 1132,adaptive_bayesian_lcb,232,coding,0.772,0.85,1,0.7629,False,True
1134
+ 1133,adaptive_bayesian_lcb,233,research,0.932,0.96,1,0.7639,False,True
1135
+ 1134,adaptive_bayesian_lcb,234,analysis,0.778,0.93,1,0.765,False,True
1136
+ 1135,adaptive_bayesian_lcb,235,planning,0.79,0.96,1,0.766,False,True
1137
+ 1136,adaptive_bayesian_lcb,236,coding,0.915,0.88,1,0.7669,False,True
1138
+ 1137,adaptive_bayesian_lcb,237,research,0.782,0.15,0,0.7637,False,True
1139
+ 1138,adaptive_bayesian_lcb,238,analysis,0.878,0.92,1,0.7647,False,True
1140
+ 1139,adaptive_bayesian_lcb,239,planning,0.938,0.89,1,0.7657,False,True
1141
+ 1140,adaptive_bayesian_lcb,240,coding,0.737,0.88,1,0.7667,False,True
1142
+ 1141,adaptive_bayesian_lcb,241,research,0.796,0.96,1,0.7676,False,True
1143
+ 1142,adaptive_bayesian_lcb,242,analysis,0.761,0.96,1,0.7686,False,True
1144
+ 1143,adaptive_bayesian_lcb,243,planning,0.734,0.87,1,0.7695,False,True
1145
+ 1144,adaptive_bayesian_lcb,244,coding,0.851,0.97,1,0.7705,False,True
1146
+ 1145,adaptive_bayesian_lcb,245,research,0.818,0.88,1,0.7714,False,True
1147
+ 1146,adaptive_bayesian_lcb,246,analysis,0.824,0.94,1,0.7724,False,True
1148
+ 1147,adaptive_bayesian_lcb,247,planning,0.886,0.96,1,0.7733,False,True
1149
+ 1148,adaptive_bayesian_lcb,248,coding,0.9,0.86,1,0.7742,False,True
1150
+ 1149,adaptive_bayesian_lcb,249,research,0.722,0.93,1,0.7751,False,True
1151
+ 1150,adaptive_bayesian_lcb,250,analysis,0.81,0.96,1,0.776,False,True
1152
+ 1151,adaptive_bayesian_lcb,251,planning,0.917,0.21,0,0.7729,False,True
1153
+ 1152,adaptive_bayesian_lcb,252,coding,0.872,0.87,1,0.7738,False,True
1154
+ 1153,adaptive_bayesian_lcb,253,research,0.761,0.9,1,0.7747,False,True
1155
+ 1154,adaptive_bayesian_lcb,254,analysis,0.903,0.94,1,0.7756,False,True
1156
+ 1155,adaptive_bayesian_lcb,255,planning,0.837,0.91,1,0.7765,False,True
1157
+ 1156,adaptive_bayesian_lcb,256,coding,0.786,0.9,1,0.7773,False,True
1158
+ 1157,adaptive_bayesian_lcb,257,research,0.756,0.92,1,0.7782,False,True
1159
+ 1158,adaptive_bayesian_lcb,258,analysis,0.919,0.94,1,0.7791,False,True
1160
+ 1159,adaptive_bayesian_lcb,259,planning,0.865,0.31,0,0.7761,False,True
1161
+ 1160,adaptive_bayesian_lcb,260,coding,0.845,0.96,1,0.7769,False,True
1162
+ 1161,adaptive_bayesian_lcb,261,research,0.808,0.85,1,0.7778,False,True
1163
+ 1162,adaptive_bayesian_lcb,262,analysis,0.902,0.86,1,0.7786,False,True
1164
+ 1163,adaptive_bayesian_lcb,263,planning,0.847,0.86,1,0.7795,False,True
1165
+ 1164,adaptive_bayesian_lcb,264,coding,0.936,0.86,1,0.7803,False,True
1166
+ 1165,adaptive_bayesian_lcb,265,research,0.851,0.85,1,0.7811,False,True
1167
+ 1166,adaptive_bayesian_lcb,266,analysis,0.865,0.86,1,0.782,False,True
1168
+ 1167,adaptive_bayesian_lcb,267,planning,0.758,0.89,1,0.7828,False,True
1169
+ 1168,adaptive_bayesian_lcb,268,coding,0.926,0.97,1,0.7836,False,True
1170
+ 1169,adaptive_bayesian_lcb,269,research,0.777,0.24,0,0.7807,False,True
1171
+ 1170,adaptive_bayesian_lcb,270,analysis,0.796,0.86,1,0.7815,False,True
1172
+ 1171,adaptive_bayesian_lcb,271,planning,0.872,0.88,1,0.7823,False,True
1173
+ 1172,adaptive_bayesian_lcb,272,coding,0.855,0.92,1,0.7831,False,True
1174
+ 1173,adaptive_bayesian_lcb,273,research,0.799,0.95,1,0.7839,False,True
1175
+ 1174,adaptive_bayesian_lcb,274,analysis,0.825,0.89,1,0.7847,False,True
1176
+ 1175,adaptive_bayesian_lcb,275,planning,0.897,0.88,1,0.7855,False,True
1177
+ 1176,adaptive_bayesian_lcb,276,coding,0.739,0.91,1,0.7862,False,True
1178
+ 1177,adaptive_bayesian_lcb,277,research,0.905,0.9,1,0.787,False,True
1179
+ 1178,adaptive_bayesian_lcb,278,analysis,0.898,0.9,1,0.7878,False,True
1180
+ 1179,adaptive_bayesian_lcb,279,planning,0.821,0.96,1,0.7885,False,True
1181
+ 1180,adaptive_bayesian_lcb,280,coding,0.746,0.29,0,0.7857,False,True
1182
+ 1181,adaptive_bayesian_lcb,281,research,0.837,0.91,1,0.7865,False,True
1183
+ 1182,adaptive_bayesian_lcb,282,analysis,0.81,0.93,1,0.7872,False,True
1184
+ 1183,adaptive_bayesian_lcb,283,planning,0.934,0.94,1,0.788,False,True
1185
+ 1184,adaptive_bayesian_lcb,284,coding,0.735,0.86,1,0.7887,False,True
1186
+ 1185,adaptive_bayesian_lcb,285,research,0.855,0.28,0,0.786,False,True
1187
+ 1186,adaptive_bayesian_lcb,286,analysis,0.737,0.92,1,0.7867,False,True
1188
+ 1187,adaptive_bayesian_lcb,287,planning,0.809,0.95,1,0.7875,False,True
1189
+ 1188,adaptive_bayesian_lcb,288,coding,0.855,0.88,1,0.7882,False,True
1190
+ 1189,adaptive_bayesian_lcb,289,research,0.743,0.9,1,0.7889,False,True
1191
+ 1190,adaptive_bayesian_lcb,290,analysis,0.869,0.86,1,0.7897,False,True
1192
+ 1191,adaptive_bayesian_lcb,291,planning,0.807,0.87,1,0.7904,False,True
1193
+ 1192,adaptive_bayesian_lcb,292,coding,0.902,0.9,1,0.7911,False,True
1194
+ 1193,adaptive_bayesian_lcb,293,research,0.757,0.92,1,0.7918,False,True
1195
+ 1194,adaptive_bayesian_lcb,294,analysis,0.771,0.94,1,0.7925,False,True
1196
+ 1195,adaptive_bayesian_lcb,295,planning,0.931,0.96,1,0.7932,False,True
1197
+ 1196,adaptive_bayesian_lcb,296,coding,0.926,0.28,0,0.7905,False,True
1198
+ 1197,adaptive_bayesian_lcb,297,research,0.859,0.94,1,0.7912,False,True
1199
+ 1198,adaptive_bayesian_lcb,298,analysis,0.837,0.9,1,0.7919,False,True
1200
+ 1199,adaptive_bayesian_lcb,299,planning,0.881,0.87,1,0.7926,False,True
1201
+ 1200,adaptive_bayesian_lcb,300,coding,0.903,0.95,1,0.7933,False,True
index.html CHANGED
@@ -1,19 +1,1097 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  </html>
 
1
+ <!DOCTYPE html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="UTF-8">
5
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
6
+ <title>Adaptive Agent Memory Resilience Playground</title>
7
+ <link rel="preconnect" href="https://fonts.googleapis.com">
8
+ <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
9
+ <link href="https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&family=JetBrains+Mono:wght@400;500;600&display=swap" rel="stylesheet">
10
+ <script src="https://cdn.plot.ly/plotly-2.35.2.min.js"></script>
11
+ <style>
12
+ :root {
13
+ --bg-primary: #0f172a;
14
+ --bg-surface: #1e293b;
15
+ --bg-card: #243247;
16
+ --bg-card-hover: #2d3e58;
17
+ --border-subtle: #334155;
18
+ --border-active: #3b82f6;
19
+ --text-primary: #f8fafc;
20
+ --text-secondary: #94a3b8;
21
+ --text-muted: #64748b;
22
+ --accent-blue: #3b82f6;
23
+ --accent-indigo: #6366f1;
24
+ --accent-green: #10b981;
25
+ --accent-red: #ef4444;
26
+ --accent-purple: #8b5cf6;
27
+ --font-sans: 'Inter', -apple-system, BlinkMacSystemFont, sans-serif;
28
+ --font-mono: 'JetBrains Mono', monospace;
29
+ }
30
+
31
+ * {
32
+ box-sizing: border-box;
33
+ margin: 0;
34
+ padding: 0;
35
+ }
36
+
37
+ body {
38
+ background-color: var(--bg-primary);
39
+ color: var(--text-primary);
40
+ font-family: var(--font-sans);
41
+ line-height: 1.5;
42
+ -webkit-font-smoothing: antialiased;
43
+ padding: 24px;
44
+ }
45
+
46
+ .container {
47
+ max-width: 1240px;
48
+ margin: 0 auto;
49
+ }
50
+
51
+ header {
52
+ margin-bottom: 24px;
53
+ padding-bottom: 20px;
54
+ border-bottom: 1px solid var(--border-subtle);
55
+ }
56
+
57
+ .badge-bar {
58
+ display: flex;
59
+ gap: 10px;
60
+ margin-bottom: 12px;
61
+ flex-wrap: wrap;
62
+ }
63
+
64
+ .badge {
65
+ font-size: 12px;
66
+ font-weight: 600;
67
+ padding: 4px 10px;
68
+ border-radius: 6px;
69
+ text-transform: uppercase;
70
+ letter-spacing: 0.5px;
71
+ }
72
+
73
+ .badge-primary { background: rgba(59, 130, 246, 0.15); color: #60a5fa; border: 1px solid rgba(59, 130, 246, 0.3); }
74
+ .badge-success { background: rgba(16, 185, 129, 0.15); color: #34d399; border: 1px solid rgba(16, 185, 129, 0.3); }
75
+ .badge-muted { background: rgba(148, 163, 184, 0.15); color: #cbd5e1; border: 1px solid rgba(148, 163, 184, 0.3); }
76
+
77
+ h1 {
78
+ font-size: 28px;
79
+ font-weight: 700;
80
+ letter-spacing: -0.5px;
81
+ color: #ffffff;
82
+ margin-bottom: 6px;
83
+ }
84
+
85
+ .subtitle {
86
+ color: var(--text-secondary);
87
+ font-size: 15px;
88
+ max-width: 900px;
89
+ margin-bottom: 14px;
90
+ }
91
+
92
+ .meta-links {
93
+ display: flex;
94
+ gap: 16px;
95
+ font-size: 13px;
96
+ flex-wrap: wrap;
97
+ }
98
+
99
+ .meta-links a {
100
+ color: #93c5fd;
101
+ text-decoration: none;
102
+ font-weight: 500;
103
+ transition: color 0.15s ease;
104
+ }
105
+
106
+ .meta-links a:hover {
107
+ color: #ffffff;
108
+ text-decoration: underline;
109
+ }
110
+
111
+ /* Tabs */
112
+ .tabs-nav {
113
+ display: flex;
114
+ gap: 8px;
115
+ margin-bottom: 24px;
116
+ border-bottom: 1px solid var(--border-subtle);
117
+ padding-bottom: 4px;
118
+ }
119
+
120
+ .tab-btn {
121
+ background: transparent;
122
+ border: none;
123
+ color: var(--text-secondary);
124
+ font-family: var(--font-sans);
125
+ font-size: 14px;
126
+ font-weight: 600;
127
+ padding: 10px 18px;
128
+ border-radius: 8px 8px 0 0;
129
+ cursor: pointer;
130
+ transition: all 0.15s ease;
131
+ position: relative;
132
+ }
133
+
134
+ .tab-btn:hover {
135
+ color: var(--text-primary);
136
+ background: rgba(255, 255, 255, 0.04);
137
+ }
138
+
139
+ .tab-btn.active {
140
+ color: #ffffff;
141
+ background: var(--bg-surface);
142
+ border-bottom: 2px solid var(--accent-blue);
143
+ }
144
+
145
+ .tab-content {
146
+ display: none;
147
+ }
148
+
149
+ .tab-content.active {
150
+ display: block;
151
+ }
152
+
153
+ /* Grid Layouts */
154
+ .layout-2col {
155
+ display: grid;
156
+ grid-template-columns: 360px 1fr;
157
+ gap: 24px;
158
+ }
159
+
160
+ @media (max-width: 960px) {
161
+ .layout-2col {
162
+ grid-template-columns: 1fr;
163
+ }
164
+ }
165
+
166
+ .card {
167
+ background: var(--bg-surface);
168
+ border: 1px solid var(--border-subtle);
169
+ border-radius: 10px;
170
+ padding: 20px;
171
+ margin-bottom: 20px;
172
+ }
173
+
174
+ .card h3 {
175
+ font-size: 16px;
176
+ font-weight: 600;
177
+ margin-bottom: 16px;
178
+ color: #ffffff;
179
+ display: flex;
180
+ align-items: center;
181
+ justify-content: space-between;
182
+ }
183
+
184
+ /* Controls */
185
+ .control-group {
186
+ margin-bottom: 18px;
187
+ }
188
+
189
+ .control-label {
190
+ display: flex;
191
+ justify-content: space-between;
192
+ font-size: 13px;
193
+ font-weight: 500;
194
+ color: var(--text-secondary);
195
+ margin-bottom: 6px;
196
+ }
197
+
198
+ .control-val {
199
+ font-family: var(--font-mono);
200
+ font-weight: 600;
201
+ color: #93c5fd;
202
+ }
203
+
204
+ input[type="range"] {
205
+ width: 100%;
206
+ height: 6px;
207
+ background: #334155;
208
+ border-radius: 3px;
209
+ outline: none;
210
+ -webkit-appearance: none;
211
+ }
212
+
213
+ input[type="range"]::-webkit-slider-thumb {
214
+ -webkit-appearance: none;
215
+ width: 16px;
216
+ height: 16px;
217
+ border-radius: 50%;
218
+ background: var(--accent-blue);
219
+ cursor: pointer;
220
+ border: 2px solid #ffffff;
221
+ transition: transform 0.1s;
222
+ }
223
+
224
+ input[type="range"]::-webkit-slider-thumb:hover {
225
+ transform: scale(1.2);
226
+ }
227
+
228
+ /* KPI Grid */
229
+ .kpi-grid {
230
+ display: grid;
231
+ grid-template-columns: repeat(4, 1fr);
232
+ gap: 14px;
233
+ margin-bottom: 20px;
234
+ }
235
+
236
+ @media (max-width: 768px) {
237
+ .kpi-grid {
238
+ grid-template-columns: repeat(2, 1fr);
239
+ }
240
+ }
241
+
242
+ .kpi-card {
243
+ background: var(--bg-card);
244
+ border: 1px solid var(--border-subtle);
245
+ border-radius: 8px;
246
+ padding: 14px 16px;
247
+ }
248
+
249
+ .kpi-title {
250
+ font-size: 12px;
251
+ font-weight: 500;
252
+ color: var(--text-muted);
253
+ text-transform: uppercase;
254
+ letter-spacing: 0.5px;
255
+ margin-bottom: 6px;
256
+ }
257
+
258
+ .kpi-value {
259
+ font-family: var(--font-mono);
260
+ font-size: 22px;
261
+ font-weight: 700;
262
+ color: #ffffff;
263
+ }
264
+
265
+ /* Status Banner */
266
+ .status-banner {
267
+ padding: 14px 18px;
268
+ border-radius: 8px;
269
+ font-weight: 600;
270
+ font-size: 14px;
271
+ margin-bottom: 18px;
272
+ display: flex;
273
+ justify-content: space-between;
274
+ align-items: center;
275
+ }
276
+
277
+ .status-active {
278
+ background: rgba(16, 185, 129, 0.12);
279
+ border: 1px solid rgba(16, 185, 129, 0.4);
280
+ color: #34d399;
281
+ }
282
+
283
+ .status-quarantined {
284
+ background: rgba(239, 68, 68, 0.12);
285
+ border: 1px solid rgba(239, 68, 68, 0.4);
286
+ color: #f87171;
287
+ }
288
+
289
+ /* Chart Container */
290
+ #betaPlot {
291
+ width: 100%;
292
+ height: 420px;
293
+ border-radius: 8px;
294
+ background: #1e293b;
295
+ }
296
+
297
+ /* Tables */
298
+ .table-container {
299
+ overflow-x: auto;
300
+ margin-top: 12px;
301
+ }
302
+
303
+ table {
304
+ width: 100%;
305
+ border-collapse: collapse;
306
+ font-size: 13px;
307
+ text-align: left;
308
+ }
309
+
310
+ th {
311
+ background: var(--bg-card);
312
+ color: var(--text-secondary);
313
+ font-weight: 600;
314
+ padding: 10px 14px;
315
+ border-bottom: 1px solid var(--border-subtle);
316
+ font-family: var(--font-sans);
317
+ }
318
+
319
+ td {
320
+ padding: 10px 14px;
321
+ border-bottom: 1px solid var(--border-subtle);
322
+ color: var(--text-primary);
323
+ }
324
+
325
+ tr:hover td {
326
+ background: rgba(255, 255, 255, 0.02);
327
+ }
328
+
329
+ .cell-mono {
330
+ font-family: var(--font-mono);
331
+ font-weight: 500;
332
+ }
333
+
334
+ .tag-q {
335
+ font-size: 11px;
336
+ font-weight: 600;
337
+ padding: 3px 8px;
338
+ border-radius: 4px;
339
+ display: inline-block;
340
+ }
341
+
342
+ .tag-active { background: rgba(16, 185, 129, 0.15); color: #34d399; border: 1px solid rgba(16, 185, 129, 0.3); }
343
+ .tag-quarantine { background: rgba(239, 68, 68, 0.15); color: #f87171; border: 1px solid rgba(239, 68, 68, 0.3); }
344
+
345
+ .formula-box {
346
+ background: #111827;
347
+ border: 1px solid var(--border-subtle);
348
+ border-radius: 8px;
349
+ padding: 14px 18px;
350
+ font-family: var(--font-mono);
351
+ font-size: 13px;
352
+ color: #93c5fd;
353
+ margin-bottom: 16px;
354
+ overflow-x: auto;
355
+ }
356
+
357
+ .btn {
358
+ background: var(--accent-blue);
359
+ color: #ffffff;
360
+ border: none;
361
+ padding: 8px 16px;
362
+ font-size: 13px;
363
+ font-weight: 600;
364
+ border-radius: 6px;
365
+ cursor: pointer;
366
+ font-family: var(--font-sans);
367
+ transition: background 0.15s ease;
368
+ }
369
+
370
+ .btn:hover {
371
+ background: #2563eb;
372
+ }
373
+
374
+ .btn-secondary {
375
+ background: var(--bg-card);
376
+ border: 1px solid var(--border-subtle);
377
+ color: var(--text-primary);
378
+ }
379
+
380
+ .btn-secondary:hover {
381
+ background: var(--bg-card-hover);
382
+ }
383
+
384
+ footer {
385
+ margin-top: 40px;
386
+ padding-top: 20px;
387
+ border-top: 1px solid var(--border-subtle);
388
+ font-size: 13px;
389
+ color: var(--text-muted);
390
+ text-align: center;
391
+ }
392
+ </style>
393
+ </head>
394
+ <body>
395
+ <div class="container">
396
+ <header>
397
+ <div class="badge-bar">
398
+ <span class="badge badge-primary">Research Benchmark</span>
399
+ <span class="badge badge-success">Statistical Inference Engine</span>
400
+ <span class="badge badge-muted">Zero Emojis Enforced</span>
401
+ </div>
402
+ <h1>Adaptive Agent Memory Resilience Playground</h1>
403
+ <p class="subtitle">
404
+ Interactive evaluation of Bayesian Beta-Bernoulli trust updating, epistemic variance quantification,
405
+ pessimistic Lower Confidence Bound (LCB) composite retrieval, and Theorem 1 statistical quarantine for autonomous LLM agents.
406
+ </p>
407
+ <div class="meta-links">
408
+ <span>Author: <strong>Sumit Das</strong> (<a href="https://huggingface.co/sumitaidev" target="_blank">@sumitaidev</a>)</span>
409
+ <span>Benchmark: <a href="https://huggingface.co/datasets/sumitaidev/agent-memory-resilience-benchmark" target="_blank">Hugging Face Dataset</a></span>
410
+ <span>Kaggle: <a href="https://www.kaggle.com/sumitdevai" target="_blank">Kaggle Benchmarks</a></span>
411
+ <span>Paper: <strong>arXiv:2026.xxxxx</strong></span>
412
+ </div>
413
+ </header>
414
+
415
+ <div class="tabs-nav">
416
+ <button class="tab-btn active" onclick="switchTab('tab1', this)">1. Bayesian Reliability & Theorem 1</button>
417
+ <button class="tab-btn" onclick="switchTab('tab2', this)">2. Pessimistic LCB Retrieval Playground</button>
418
+ <button class="tab-btn" onclick="switchTab('tab3', this)">3. Benchmark Telemetry & Empirical Ablation</button>
419
+ </div>
420
+
421
+ <!-- TAB 1 -->
422
+ <div id="tab1" class="tab-content active">
423
+ <div class="layout-2col">
424
+ <div>
425
+ <div class="card">
426
+ <h3>Prior Parameters</h3>
427
+ <div class="control-group">
428
+ <div class="control-label">
429
+ <span>Prior Alpha (alpha_0)</span>
430
+ <span class="control-val" id="val_a0">3.0</span>
431
+ </div>
432
+ <input type="range" id="input_a0" min="0.5" max="10.0" step="0.5" value="3.0" oninput="updateState()">
433
+ </div>
434
+ <div class="control-group">
435
+ <div class="control-label">
436
+ <span>Prior Beta (beta_0)</span>
437
+ <span class="control-val" id="val_b0">1.0</span>
438
+ </div>
439
+ <input type="range" id="input_b0" min="0.5" max="10.0" step="0.5" value="1.0" oninput="updateState()">
440
+ </div>
441
+ </div>
442
+
443
+ <div class="card">
444
+ <h3>Observed Experience Trials</h3>
445
+ <div class="control-group">
446
+ <div class="control-label">
447
+ <span>Task Successes (n_s)</span>
448
+ <span class="control-val" id="val_ns">0</span>
449
+ </div>
450
+ <input type="range" id="input_ns" min="0" max="50" step="1" value="0" oninput="updateState()">
451
+ </div>
452
+ <div class="control-group">
453
+ <div class="control-label">
454
+ <span>Task Failures (n_f)</span>
455
+ <span class="control-val" id="val_nf">0</span>
456
+ </div>
457
+ <input type="range" id="input_nf" min="0" max="20" step="1" value="0" oninput="updateState()">
458
+ </div>
459
+ </div>
460
+
461
+ <div class="card">
462
+ <h3>Inference & Risk Hyperparameters</h3>
463
+ <div class="control-group">
464
+ <div class="control-label">
465
+ <span>Risk Aversion (lambda)</span>
466
+ <span class="control-val" id="val_lam">1.0</span>
467
+ </div>
468
+ <input type="range" id="input_lam" min="0.0" max="3.0" step="0.2" value="1.0" oninput="updateState()">
469
+ </div>
470
+ <div class="control-group">
471
+ <div class="control-label">
472
+ <span>Admissibility Threshold (theta_0)</span>
473
+ <span class="control-val" id="val_thresh">0.70</span>
474
+ </div>
475
+ <input type="range" id="input_thresh" min="0.50" max="0.90" step="0.05" value="0.70" oninput="updateState()">
476
+ </div>
477
+ <div class="control-group">
478
+ <div class="control-label">
479
+ <span>Significance Level (gamma)</span>
480
+ <span class="control-val" id="val_gamma">0.05</span>
481
+ </div>
482
+ <input type="range" id="input_gamma" min="0.01" max="0.20" step="0.01" value="0.05" oninput="updateState()">
483
+ </div>
484
+ </div>
485
+ </div>
486
+
487
+ <div>
488
+ <div class="kpi-grid">
489
+ <div class="kpi-card">
490
+ <div class="kpi-title">Posterior Mean E[theta]</div>
491
+ <div class="kpi-value" id="kpi_mean">0.7500</div>
492
+ </div>
493
+ <div class="kpi-card">
494
+ <div class="kpi-title">Uncertainty (sigma)</div>
495
+ <div class="kpi-value" id="kpi_sigma">0.1936</div>
496
+ </div>
497
+ <div class="kpi-card">
498
+ <div class="kpi-title">LCB Score (lambda=1.0)</div>
499
+ <div class="kpi-value" id="kpi_lcb">0.5564</div>
500
+ </div>
501
+ <div class="kpi-card">
502
+ <div class="kpi-title">P(theta > threshold)</div>
503
+ <div class="kpi-value" id="kpi_prob">65.70%</div>
504
+ </div>
505
+ </div>
506
+
507
+ <div id="statusBanner" class="status-banner status-active">
508
+ <span>OPERATIONAL STATUS: ACTIVE (Admissible for Agent Memory Bank)</span>
509
+ <span class="cell-mono" id="statusDetail">P(theta > 0.70) = 65.70% >= 5.00%</span>
510
+ </div>
511
+
512
+ <div class="card">
513
+ <h3>Posterior Distribution & Uncertainty Quantification</h3>
514
+ <div id="betaPlot"></div>
515
+ </div>
516
+
517
+ <div class="card">
518
+ <h3>Theorem 1 Verification: Consecutive Failure Trajectory</h3>
519
+ <p style="font-size: 13px; color: var(--text-secondary); margin-bottom: 12px;">
520
+ Minimum consecutive failures to trigger deterministic quarantine:
521
+ t* = min { t in N : P(theta > 0.70 | 0, t) < 0.05 } = exactly 4 trials under weakly-informative prior Beta(3, 1).
522
+ </p>
523
+ <div class="table-container">
524
+ <table id="trajectoryTable">
525
+ <thead>
526
+ <tr>
527
+ <th>Consecutive Failures (t)</th>
528
+ <th>Posterior Distribution</th>
529
+ <th>Posterior Mean E[theta]</th>
530
+ <th>Epistemic Uncertainty (sigma)</th>
531
+ <th>P(theta > threshold)</th>
532
+ <th>Quarantine Status</th>
533
+ </tr>
534
+ </thead>
535
+ <tbody id="trajectoryTbody">
536
+ <!-- Populated dynamically -->
537
+ </tbody>
538
+ </table>
539
+ </div>
540
+ </div>
541
+ </div>
542
+ </div>
543
+ </div>
544
+
545
+ <!-- TAB 2 -->
546
+ <div id="tab2" class="tab-content">
547
+ <div class="card">
548
+ <h3>Pessimistic LCB Memory Retrieval vs Naive Vector Search</h3>
549
+ <p class="subtitle" style="margin-bottom: 16px;">
550
+ Simulates a real-world task query where an agent must select an episodic strategy.
551
+ Corrupted strategies repeatedly retrieve high semantic cosine similarity, causing cascading failures under naive RAG.
552
+ Our composite score: <strong>Score(e; q) = Sim(q, v_e) * LCB_lambda(e)</strong> suppresses corrupted memories and penalizes untested uncertainty.
553
+ </p>
554
+
555
+ <div class="formula-box">
556
+ Retrieval Composite Scoring:
557
+ Score(e; q) = Sim(q, v_e) * max(0.0, E[theta | n_s, n_f] - lambda * sqrt(Var[theta | n_s, n_f]))
558
+ </div>
559
+
560
+ <div class="control-group" style="max-width: 480px; margin-bottom: 24px;">
561
+ <div class="control-label">
562
+ <span>Risk Aversion Parameter (lambda)</span>
563
+ <span class="control-val" id="val_tab2_lam">1.0</span>
564
+ </div>
565
+ <input type="range" id="input_tab2_lam" min="0.0" max="3.0" step="0.25" value="1.0" oninput="updateTab2()">
566
+ </div>
567
+
568
+ <div class="table-container">
569
+ <table>
570
+ <thead>
571
+ <tr>
572
+ <th>LCB Rank</th>
573
+ <th>Memory ID</th>
574
+ <th>Domain</th>
575
+ <th>Semantic Cosine Sim</th>
576
+ <th>Successes (n_s)</th>
577
+ <th>Failures (n_f)</th>
578
+ <th>Posterior Mean</th>
579
+ <th>LCB Score</th>
580
+ <th>Naive Score (Sim)</th>
581
+ <th>Proposed Composite Score</th>
582
+ <th>Status</th>
583
+ <th>Operational Directive</th>
584
+ </tr>
585
+ </thead>
586
+ <tbody id="retrievalTbody">
587
+ <!-- Dynamically populated -->
588
+ </tbody>
589
+ </table>
590
+ </div>
591
+
592
+ <div style="margin-top: 20px; padding: 14px; background: rgba(59, 130, 246, 0.08); border: 1px solid rgba(59, 130, 246, 0.2); border-radius: 8px; font-size: 13px;">
593
+ <strong>Analytical Inspection:</strong>
594
+ <ul style="margin-left: 20px; margin-top: 6px;">
595
+ <li><strong>lambda = 0.0 (Naive Cosine):</strong> <code>MEM-CORRUPT-01</code> ranks #1 (score 0.940) despite 5 empirical failures. Agent succumbs to negative transfer.</li>
596
+ <li><strong>lambda >= 1.0 (Pessimistic LCB):</strong> <code>MEM-CORRUPT-01</code> is pruned or suppressed. <code>MEM-ROBUST-02</code> (22 successes, 1 failure) correctly assumes rank #1.</li>
597
+ <li><strong>MEM-UNTESTED-03:</strong> Has high semantic similarity (0.890) but zero execution history; its epistemic uncertainty penalty prevents naive over-reliance.</li>
598
+ </ul>
599
+ </div>
600
+ </div>
601
+ </div>
602
+
603
+ <!-- TAB 3 -->
604
+ <div id="tab3" class="tab-content">
605
+ <div class="card">
606
+ <h3>Empirical Benchmark Telemetry (1,200 Execution Steps)</h3>
607
+ <p class="subtitle">
608
+ Experimental comparison across 4 controlled conditions under an adversarial noise injection window (steps 60 to 140).
609
+ </p>
610
+ <div class="table-container">
611
+ <table>
612
+ <thead>
613
+ <tr>
614
+ <th>Ablation Condition</th>
615
+ <th>Total Steps</th>
616
+ <th>Task Accuracy</th>
617
+ <th>Average Reward</th>
618
+ <th>Mean Cosine Sim</th>
619
+ <th>Quarantine Triggers</th>
620
+ <th>Core Mechanism</th>
621
+ </tr>
622
+ </thead>
623
+ <tbody>
624
+ <tr>
625
+ <td><strong>Condition A: Vanilla Baseline</strong></td>
626
+ <td class="cell-mono">300</td>
627
+ <td class="cell-mono">48.33%</td>
628
+ <td class="cell-mono">0.483</td>
629
+ <td class="cell-mono">0.000</td>
630
+ <td class="cell-mono">0</td>
631
+ <td>Zero inter-task memory. Agent approaches each task tabula rasa.</td>
632
+ </tr>
633
+ <tr style="background: rgba(239, 68, 68, 0.08);">
634
+ <td><strong>Condition B: Naive Vector RAG</strong></td>
635
+ <td class="cell-mono">300</td>
636
+ <td class="cell-mono">32.67%</td>
637
+ <td class="cell-mono">0.327</td>
638
+ <td class="cell-mono">0.824</td>
639
+ <td class="cell-mono">0</td>
640
+ <td>Semantic cosine similarity retrieval. Collapses under memory poisoning.</td>
641
+ </tr>
642
+ <tr>
643
+ <td><strong>Condition C: Symmetric Reflexion</strong></td>
644
+ <td class="cell-mono">300</td>
645
+ <td class="cell-mono">61.25%</td>
646
+ <td class="cell-mono">0.613</td>
647
+ <td class="cell-mono">0.789</td>
648
+ <td class="cell-mono">0</td>
649
+ <td>Symmetric Exponential Moving Average (EMA). Lacks uncertainty bounds.</td>
650
+ </tr>
651
+ <tr style="background: rgba(16, 185, 129, 0.08); font-weight: 600;">
652
+ <td><strong>Condition D: Adaptive Bayesian LCB (Proposed)</strong></td>
653
+ <td class="cell-mono">300</td>
654
+ <td class="cell-mono">84.58%</td>
655
+ <td class="cell-mono">0.846</td>
656
+ <td class="cell-mono">0.742</td>
657
+ <td class="cell-mono">42</td>
658
+ <td>Conjugate Beta-Bernoulli, LCB composite retrieval, Theorem 1 quarantine. (+51.91% over naive RAG).</td>
659
+ </tr>
660
+ </tbody>
661
+ </table>
662
+ </div>
663
+ </div>
664
+
665
+ <div class="card">
666
+ <h3>Academic Citation & Reproducibility</h3>
667
+ <p style="font-size: 13px; color: var(--text-secondary); margin-bottom: 12px;">
668
+ Use the following BibTeX entry to cite this benchmark and methodology in research:
669
+ </p>
670
+ <div class="formula-box" id="bibtexText">@article{das2026adaptive,
671
+ title={Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval},
672
+ author={Das, Sumit},
673
+ journal={arXiv preprint},
674
+ year={2026}
675
+ }</div>
676
+ <button class="btn btn-secondary" onclick="copyBibtex()">Copy BibTeX</button>
677
+ </div>
678
+ </div>
679
+
680
+ <footer>
681
+ Adaptive Agent Memory Resilience Benchmark &copy; 2026 Sumit Das. All rights reserved. Built for Hugging Face Spaces.
682
+ </footer>
683
+ </div>
684
+
685
+ <script>
686
+ // --- Mathematical Engine (Accurate Lanczos & Continued Fraction Incomplete Beta) ---
687
+
688
+ function logGamma(z) {
689
+ const p = [
690
+ 676.5203681218851, -1259.1392167224028, 771.32342877765313,
691
+ -176.61502916214059, 12.507343278686905, -0.13857109583654525,
692
+ 9.9843695780195716e-6, 1.5056327351493116e-7
693
+ ];
694
+ if (z < 0.5) {
695
+ return Math.log(Math.PI / Math.sin(Math.PI * z)) - logGamma(1 - z);
696
+ }
697
+ z -= 1;
698
+ let x = 0.99999999999980993;
699
+ for (let i = 0; i < p.length; i++) {
700
+ x += p[i] / (z + i + 1);
701
+ }
702
+ let t = z + p.length - 0.5;
703
+ return 0.5 * Math.log(2 * Math.PI) + (z + 0.5) * Math.log(t) - t + Math.log(x);
704
+ }
705
+
706
+ function betaCf(a, b, x, maxIter = 100, eps = 1e-12) {
707
+ const qab = a + b;
708
+ const qap = a + 1.0;
709
+ const qam = a - 1.0;
710
+ let c = 1.0;
711
+ let d = 1.0 - qab * x / qap;
712
+ if (Math.abs(d) < 1e-30) d = 1e-30;
713
+ d = 1.0 / d;
714
+ let h = d;
715
+ for (let m = 1; m <= maxIter; m++) {
716
+ let m2 = 2 * m;
717
+ // Even step
718
+ let aa = m * (b - m) * x / ((qam + m2) * (a + m2));
719
+ d = 1.0 + aa * d;
720
+ if (Math.abs(d) < 1e-30) d = 1e-30;
721
+ c = 1.0 + aa / c;
722
+ if (Math.abs(c) < 1e-30) c = 1e-30;
723
+ d = 1.0 / d;
724
+ h *= d * c;
725
+ // Odd step
726
+ aa = -(a + m) * (qab + m) * x / ((a + m2) * (qap + m2));
727
+ d = 1.0 + aa * d;
728
+ if (Math.abs(d) < 1e-30) d = 1e-30;
729
+ c = 1.0 + aa / c;
730
+ if (Math.abs(c) < 1e-30) c = 1e-30;
731
+ d = 1.0 / d;
732
+ let del = d * c;
733
+ h *= del;
734
+ if (Math.abs(del - 1.0) < eps) break;
735
+ }
736
+ return h;
737
+ }
738
+
739
+ function regularizedBetainc(a, b, x) {
740
+ if (x <= 0.0) return 0.0;
741
+ if (x >= 1.0) return 1.0;
742
+ let bt = Math.exp(logGamma(a + b) - logGamma(a) - logGamma(b) + a * Math.log(x) + b * Math.log(1.0 - x));
743
+ if (x < (a + 1.0) / (a + b + 2.0)) {
744
+ return bt * betaCf(a, b, x) / a;
745
+ } else {
746
+ return 1.0 - bt * betaCf(b, a, 1.0 - x) / b;
747
+ }
748
+ }
749
+
750
+ function betaPdf(x, a, b) {
751
+ if (x <= 0.0 || x >= 1.0) return 0.0;
752
+ let lnorm = logGamma(a + b) - logGamma(a) - logGamma(b);
753
+ let logVal = lnorm + (a - 1.0) * Math.log(x) + (b - 1.0) * Math.log(1.0 - x);
754
+ return Math.exp(logVal);
755
+ }
756
+
757
+ function betaTrustMean(ns, nf, a0 = 3.0, b0 = 1.0) {
758
+ let a = a0 + ns;
759
+ let b = b0 + nf;
760
+ return a / (a + b);
761
+ }
762
+
763
+ function betaTrustVar(ns, nf, a0 = 3.0, b0 = 1.0) {
764
+ let a = a0 + ns;
765
+ let b = b0 + nf;
766
+ let total = a + b;
767
+ return (a * b) / (Math.pow(total, 2) * (total + 1.0));
768
+ }
769
+
770
+ function betaTrustStd(ns, nf, a0 = 3.0, b0 = 1.0) {
771
+ return Math.sqrt(betaTrustVar(ns, nf, a0, b0));
772
+ }
773
+
774
+ function betaLcb(ns, nf, lam = 1.0, a0 = 3.0, b0 = 1.0) {
775
+ let mu = betaTrustMean(ns, nf, a0, b0);
776
+ let std = betaTrustStd(ns, nf, a0, b0);
777
+ return Math.max(0.0, Math.min(1.0, mu - lam * std));
778
+ }
779
+
780
+ function posteriorProbReliable(ns, nf, threshold = 0.70, a0 = 3.0, b0 = 1.0) {
781
+ let a = a0 + ns;
782
+ let b = b0 + nf;
783
+ let cdf = regularizedBetainc(a, b, threshold);
784
+ return Math.max(0.0, Math.min(1.0, 1.0 - cdf));
785
+ }
786
+
787
+ function shouldQuarantine(ns, nf, gamma = 0.05, threshold = 0.70, a0 = 3.0, b0 = 1.0) {
788
+ return posteriorProbReliable(ns, nf, threshold, a0, b0) < gamma;
789
+ }
790
+
791
+ // --- Tab Switching ---
792
+ function switchTab(tabId, el) {
793
+ document.querySelectorAll('.tab-content').forEach(c => c.classList.remove('active'));
794
+ document.querySelectorAll('.tab-btn').forEach(b => b.classList.remove('active'));
795
+ document.getElementById(tabId).classList.add('active');
796
+ el.classList.add('active');
797
+ if (tabId === 'tab1') {
798
+ Plotly.relayout('betaPlot', {});
799
+ }
800
+ }
801
+
802
+ // --- Tab 1 Dynamic Updates ---
803
+ function updateState() {
804
+ let a0 = parseFloat(document.getElementById('input_a0').value);
805
+ let b0 = parseFloat(document.getElementById('input_b0').value);
806
+ let ns = parseInt(document.getElementById('input_ns').value);
807
+ let nf = parseInt(document.getElementById('input_nf').value);
808
+ let lam = parseFloat(document.getElementById('input_lam').value);
809
+ let thresh = parseFloat(document.getElementById('input_thresh').value);
810
+ let gam = parseFloat(document.getElementById('input_gamma').value);
811
+
812
+ document.getElementById('val_a0').textContent = a0.toFixed(1);
813
+ document.getElementById('val_b0').textContent = b0.toFixed(1);
814
+ document.getElementById('val_ns').textContent = ns;
815
+ document.getElementById('val_nf').textContent = nf;
816
+ document.getElementById('val_lam').textContent = lam.toFixed(1);
817
+ document.getElementById('val_thresh').textContent = thresh.toFixed(2);
818
+ document.getElementById('val_gamma').textContent = gam.toFixed(2);
819
+
820
+ let mu = betaTrustMean(ns, nf, a0, b0);
821
+ let std = betaTrustStd(ns, nf, a0, b0);
822
+ let lcb = betaLcb(ns, nf, lam, a0, b0);
823
+ let pRel = posteriorProbReliable(ns, nf, thresh, a0, b0);
824
+ let isQuarantined = pRel < gam;
825
+
826
+ document.getElementById('kpi_mean').textContent = mu.toFixed(4);
827
+ document.getElementById('kpi_sigma').textContent = std.toFixed(4);
828
+ document.getElementById('kpi_lcb').textContent = lcb.toFixed(4);
829
+ document.getElementById('kpi_prob').textContent = (pRel * 100).toFixed(2) + '%';
830
+
831
+ let banner = document.getElementById('statusBanner');
832
+ let bannerDetail = document.getElementById('statusDetail');
833
+ if (isQuarantined) {
834
+ banner.className = 'status-banner status-quarantined';
835
+ banner.firstElementChild.textContent = 'OPERATIONAL STATUS: QUARANTINED (Pruned from Retrieval)';
836
+ bannerDetail.textContent = `P(theta > ${thresh.toFixed(2)}) = ${(pRel * 100).toFixed(2)}% < ${(gam * 100).toFixed(2)}% (Significance Threshold)`;
837
+ } else {
838
+ banner.className = 'status-banner status-active';
839
+ banner.firstElementChild.textContent = 'OPERATIONAL STATUS: ACTIVE (Admissible for Agent Memory Bank)';
840
+ bannerDetail.textContent = `P(theta > ${thresh.toFixed(2)}) = ${(pRel * 100).toFixed(2)}% >= ${(gam * 100).toFixed(2)}%`;
841
+ }
842
+
843
+ renderPlot(a0, b0, ns, nf, lam, thresh, pRel);
844
+ renderTrajectoryTable(a0, b0, thresh, gam);
845
+ }
846
+
847
+ function renderPlot(a0, b0, ns, nf, lam, thresh, pRel) {
848
+ let aPost = a0 + ns;
849
+ let bPost = b0 + nf;
850
+ let mu = betaTrustMean(ns, nf, a0, b0);
851
+ let lcb = betaLcb(ns, nf, lam, a0, b0);
852
+
853
+ let numPoints = 300;
854
+ let x = [];
855
+ let yPost = [];
856
+ let yPrior = [];
857
+ let xRel = [];
858
+ let yRel = [];
859
+
860
+ for (let i = 0; i < numPoints; i++) {
861
+ let val = 0.002 + (i / (numPoints - 1)) * 0.996;
862
+ x.push(val);
863
+ let yp = betaPdf(val, aPost, bPost);
864
+ let ypr = betaPdf(val, a0, b0);
865
+ yPost.push(yp);
866
+ yPrior.push(ypr);
867
+ if (val >= thresh) {
868
+ xRel.push(val);
869
+ yRel.push(yp);
870
+ }
871
+ }
872
+
873
+ let traces = [
874
+ {
875
+ x: x,
876
+ y: yPrior,
877
+ mode: 'lines',
878
+ name: `Prior Beta(${a0.toFixed(1)}, ${b0.toFixed(1)})`,
879
+ line: { color: 'rgba(148, 163, 184, 0.5)', width: 1.5, dash: 'dash' }
880
+ },
881
+ {
882
+ x: x,
883
+ y: yPost,
884
+ mode: 'lines',
885
+ name: `Posterior Beta(${aPost.toFixed(1)}, ${bPost.toFixed(1)})`,
886
+ line: { color: '#3b82f6', width: 3 }
887
+ }
888
+ ];
889
+
890
+ if (xRel.length > 0) {
891
+ traces.push({
892
+ x: [thresh, ...xRel, xRel[xRel.length - 1]],
893
+ y: [0, ...yRel, 0],
894
+ fill: 'toself',
895
+ fillcolor: 'rgba(16, 185, 129, 0.22)',
896
+ line: { color: 'transparent' },
897
+ name: `Admissible Region (P=${(pRel * 100).toFixed(1)}%)`,
898
+ hoverinfo: 'skip'
899
+ });
900
+ }
901
+
902
+ let layout = {
903
+ title: {
904
+ text: `Posterior Reliability Curve vs Prior Distribution`,
905
+ font: { color: '#f8fafc', size: 14 }
906
+ },
907
+ paper_bgcolor: '#1e293b',
908
+ plot_bgcolor: '#1e293b',
909
+ xaxis: {
910
+ title: { text: 'True Latent Reliability theta in [0, 1]', font: { color: '#94a3b8' } },
911
+ range: [0.0, 1.0],
912
+ gridcolor: '#334155',
913
+ tickfont: { color: '#94a3b8' }
914
+ },
915
+ yaxis: {
916
+ title: { text: 'Probability Density f(theta)', font: { color: '#94a3b8' } },
917
+ gridcolor: '#334155',
918
+ tickfont: { color: '#94a3b8' }
919
+ },
920
+ legend: {
921
+ orientation: 'h',
922
+ y: 1.12,
923
+ x: 1.0,
924
+ xanchor: 'right',
925
+ font: { color: '#94a3b8' }
926
+ },
927
+ margin: { l: 45, r: 25, t: 40, b: 40 },
928
+ shapes: [
929
+ {
930
+ type: 'line',
931
+ x0: thresh, x1: thresh, y0: 0, y1: 1, yref: 'paper',
932
+ line: { color: '#ef4444', width: 2, dash: 'dash' }
933
+ },
934
+ {
935
+ type: 'line',
936
+ x0: mu, x1: mu, y0: 0, y1: 1, yref: 'paper',
937
+ line: { color: '#3b82f6', width: 2 }
938
+ },
939
+ {
940
+ type: 'line',
941
+ x0: lcb, x1: lcb, y0: 0, y1: 1, yref: 'paper',
942
+ line: { color: '#8b5cf6', width: 2, dash: 'dot' }
943
+ }
944
+ ],
945
+ annotations: [
946
+ {
947
+ x: thresh, y: 0.95, yref: 'paper',
948
+ text: `Threshold (${thresh.toFixed(2)})`,
949
+ showarrow: false, font: { color: '#ef4444', size: 11 }, xanchor: 'right'
950
+ },
951
+ {
952
+ x: mu, y: 0.85, yref: 'paper',
953
+ text: `Mean (${mu.toFixed(2)})`,
954
+ showarrow: false, font: { color: '#3b82f6', size: 11 }, xanchor: 'left'
955
+ },
956
+ {
957
+ x: lcb, y: 0.15, yref: 'paper',
958
+ text: `LCB (${lcb.toFixed(2)})`,
959
+ showarrow: false, font: { color: '#8b5cf6', size: 11 }, xanchor: 'right'
960
+ }
961
+ ]
962
+ };
963
+
964
+ Plotly.react('betaPlot', traces, layout, { responsive: true, displayModeBar: false });
965
+ }
966
+
967
+ function renderTrajectoryTable(a0, b0, thresh, gam) {
968
+ let tbody = document.getElementById('trajectoryTbody');
969
+ tbody.innerHTML = '';
970
+ for (let t = 0; t <= 6; t++) {
971
+ let mu = a0 / (a0 + b0 + t);
972
+ let std = Math.sqrt((a0 * (b0 + t)) / (Math.pow(a0 + b0 + t, 2) * (a0 + b0 + t + 1)));
973
+ let pRel = posteriorProbReliable(0, t, thresh, a0, b0);
974
+ let isQ = pRel < gam;
975
+
976
+ let tr = document.createElement('tr');
977
+ if (isQ) tr.style.background = 'rgba(239, 68, 68, 0.08)';
978
+
979
+ tr.innerHTML = `
980
+ <td class="cell-mono">${t}</td>
981
+ <td class="cell-mono">Beta(${a0.toFixed(1)}, ${(b0 + t).toFixed(1)})</td>
982
+ <td class="cell-mono">${mu.toFixed(4)}</td>
983
+ <td class="cell-mono">${std.toFixed(4)}</td>
984
+ <td class="cell-mono">${(pRel * 100).toFixed(2)}%</td>
985
+ <td>
986
+ <span class="tag-q ${isQ ? 'tag-quarantine' : 'tag-active'}">
987
+ ${isQ ? 'QUARANTINED (t* threshold)' : 'ACTIVE'}
988
+ </span>
989
+ </td>
990
+ `;
991
+ tbody.appendChild(tr);
992
+ }
993
+ }
994
+
995
+ // --- Tab 2: Retrieval Ranking ---
996
+ const CANDIDATE_MEMORIES = [
997
+ {
998
+ id: "MEM-CORRUPT-01",
999
+ domain: "coding",
1000
+ lesson: "Use global shared state across async workers without mutex lock for throughput.",
1001
+ sim: 0.940,
1002
+ ns: 2,
1003
+ nf: 5,
1004
+ note: "Corrupted/stale reflection causing race condition deadlocks."
1005
+ },
1006
+ {
1007
+ id: "MEM-ROBUST-02",
1008
+ domain: "coding",
1009
+ lesson: "Implement asyncio.Lock with timeout fallback and circuit breaker isolation.",
1010
+ sim: 0.830,
1011
+ ns: 22,
1012
+ nf: 1,
1013
+ note: "High empirical validation under stress tests."
1014
+ },
1015
+ {
1016
+ id: "MEM-UNTESTED-03",
1017
+ domain: "coding",
1018
+ lesson: "Refactor threading pool to use separate child process queues.",
1019
+ sim: 0.890,
1020
+ ns: 0,
1021
+ nf: 0,
1022
+ note: "Newly distilled reflection with zero empirical execution history."
1023
+ },
1024
+ {
1025
+ id: "MEM-MARGINAL-04",
1026
+ domain: "coding",
1027
+ lesson: "Log execution traceback to local scratch buffer before propagating exceptions.",
1028
+ sim: 0.650,
1029
+ ns: 15,
1030
+ nf: 2,
1031
+ note: "Low direct task relevance, but high historical reliability."
1032
+ }
1033
+ ];
1034
+
1035
+ function updateTab2() {
1036
+ let lam = parseFloat(document.getElementById('input_tab2_lam').value);
1037
+ document.getElementById('val_tab2_lam').textContent = lam.toFixed(2);
1038
+
1039
+ let scored = CANDIDATE_MEMORIES.map(m => {
1040
+ let mu = betaTrustMean(m.ns, m.nf, 3.0, 1.0);
1041
+ let std = betaTrustStd(m.ns, m.nf, 3.0, 1.0);
1042
+ let lcb = betaLcb(m.ns, m.nf, lam, 3.0, 1.0);
1043
+ let isQ = shouldQuarantine(m.ns, m.nf, 0.05, 0.70, 3.0, 1.0);
1044
+ let naiveScore = m.sim;
1045
+ let composite = isQ ? 0.0 : m.sim * lcb;
1046
+ return {
1047
+ ...m,
1048
+ mu, std, lcb, isQ, naiveScore, composite
1049
+ };
1050
+ });
1051
+
1052
+ scored.sort((a, b) => b.composite - a.composite);
1053
+
1054
+ let tbody = document.getElementById('retrievalTbody');
1055
+ tbody.innerHTML = '';
1056
+ scored.forEach((m, idx) => {
1057
+ let tr = document.createElement('tr');
1058
+ if (m.isQ) tr.style.background = 'rgba(239, 68, 68, 0.08)';
1059
+ tr.innerHTML = `
1060
+ <td class="cell-mono">#${idx + 1}</td>
1061
+ <td class="cell-mono">${m.id}</td>
1062
+ <td>${m.domain}</td>
1063
+ <td class="cell-mono">${m.sim.toFixed(3)}</td>
1064
+ <td class="cell-mono">${m.ns}</td>
1065
+ <td class="cell-mono">${m.nf}</td>
1066
+ <td class="cell-mono">${m.mu.toFixed(3)}</td>
1067
+ <td class="cell-mono">${m.lcb.toFixed(3)}</td>
1068
+ <td class="cell-mono">${m.naiveScore.toFixed(3)}</td>
1069
+ <td class="cell-mono" style="font-weight: 700; color: ${m.composite > 0.5 ? '#34d399' : '#f87171'};">
1070
+ ${m.composite.toFixed(3)}
1071
+ </td>
1072
+ <td>
1073
+ <span class="tag-q ${m.isQ ? 'tag-quarantine' : 'tag-active'}">
1074
+ ${m.isQ ? 'QUARANTINED' : 'ACTIVE'}
1075
+ </span>
1076
+ </td>
1077
+ <td style="font-size: 12px; color: var(--text-secondary); max-width: 280px;">${m.lesson}</td>
1078
+ `;
1079
+ tbody.appendChild(tr);
1080
+ });
1081
+ }
1082
+
1083
+ function copyBibtex() {
1084
+ let text = document.getElementById('bibtexText').textContent;
1085
+ navigator.clipboard.writeText(text).then(() => {
1086
+ alert('BibTeX citation copied to clipboard.');
1087
+ });
1088
+ }
1089
+
1090
+ // Initialize on load
1091
+ window.addEventListener('DOMContentLoaded', () => {
1092
+ updateState();
1093
+ updateTab2();
1094
+ });
1095
+ </script>
1096
+ </body>
1097
  </html>
requirements.txt ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ gradio>=5.20.0
2
+ numpy>=1.24.0
3
+ scipy>=1.10.0
4
+ plotly>=5.18.0
5
+ pandas>=2.0.0