Deploy Adaptive Agent Memory Resilience Research Playground
Browse files- README.md +29 -6
- __pycache__/app.cpython-313.pyc +0 -0
- app.py +476 -0
- data/memory_bank_experiences.csv +101 -0
- data/telemetry_traces.csv +1201 -0
- index.html +1096 -18
- requirements.txt +5 -0
README.md
CHANGED
|
@@ -1,10 +1,33 @@
|
|
| 1 |
---
|
| 2 |
-
title: Adaptive Agent Memory Playground
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
-
pinned:
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Adaptive Agent Memory Resilience Playground
|
| 3 |
+
colorFrom: indigo
|
| 4 |
+
colorTo: blue
|
|
|
|
| 5 |
sdk: static
|
| 6 |
+
pinned: true
|
| 7 |
+
license: apache-2.0
|
| 8 |
+
short_description: Bayesian Trust Engine & Pessimistic LCB Retrieval
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Adaptive Agent Memory Resilience Playground
|
| 12 |
+
|
| 13 |
+
An interactive research playground demonstrating mathematical trust dynamics and pessimistic memory retrieval for autonomous LLM agents (LangGraph, AutoGen, CrewAI).
|
| 14 |
+
|
| 15 |
+
This Space accompanies the research paper:
|
| 16 |
+
**"Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval"** by Sumit Das (2026).
|
| 17 |
+
|
| 18 |
+
## Live Demonstrations
|
| 19 |
+
1. **Bayesian Reliability & Statistical Quarantine**:
|
| 20 |
+
- Conjugate Beta-Bernoulli updating ($\alpha_0=3.0, \beta_0=1.0$).
|
| 21 |
+
- Dynamic epistemic uncertainty estimation ($\sigma = \sqrt{\operatorname{Var}[\theta]}$).
|
| 22 |
+
- Incomplete Beta integral for reliability threshold $\mathbb{P}(\theta > 0.70)$.
|
| 23 |
+
- Theorem 1 deterministic quarantine trigger at $t^* = 4$ consecutive failures.
|
| 24 |
+
2. **Pessimistic LCB Memory Retriever**:
|
| 25 |
+
- Compare unweighted Cosine Similarity against the proposed composite Lower Confidence Bound ($\operatorname{LCB}_\lambda$) ranking:
|
| 26 |
+
$\operatorname{Score}(e; q) = \operatorname{Sim}(\mathbf{q}, \mathbf{v}_e) \times \operatorname{LCB}_\lambda(e)$
|
| 27 |
+
- Demonstrates suppression of corrupted high-similarity strategies under adversarial drift.
|
| 28 |
+
3. **Empirical Benchmark Explorer**:
|
| 29 |
+
- Live inspection of 1,200 execution traces and 100 experiential memories comparing 4 experimental ablation conditions.
|
| 30 |
+
|
| 31 |
+
## Dataset Reference
|
| 32 |
+
The full benchmark dataset is available at:
|
| 33 |
+
`sumitaidev/agent-memory-resilience-benchmark`
|
__pycache__/app.cpython-313.pyc
ADDED
|
Binary file (23.2 kB). View file
|
|
|
app.py
ADDED
|
@@ -0,0 +1,476 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
"""
|
| 2 |
+
Adaptive Agent Memory Resilience: Interactive Research Playground
|
| 3 |
+
Author: Sumit Das (arXiv Pre-print 2026)
|
| 4 |
+
Demonstrates Bayesian Trust Updating, Pessimistic Lower Confidence Bound (LCB) Retrieval,
|
| 5 |
+
and Theorem 1 Statistical Quarantine for Autonomous LLM Agents.
|
| 6 |
+
Strict compliance: Zero emojis, rigorous mathematical formulas, typed logic.
|
| 7 |
+
"""
|
| 8 |
+
|
| 9 |
+
import math
|
| 10 |
+
from pathlib import Path
|
| 11 |
+
from typing import Dict, List, Tuple
|
| 12 |
+
|
| 13 |
+
import gradio as gr
|
| 14 |
+
import numpy as np
|
| 15 |
+
import pandas as pd
|
| 16 |
+
import plotly.graph_objects as go
|
| 17 |
+
import scipy.special as sc
|
| 18 |
+
import scipy.stats as stats
|
| 19 |
+
|
| 20 |
+
# --- Mathematical Engine (Conjugate Beta-Bernoulli & Theorem 1) ---
|
| 21 |
+
|
| 22 |
+
def beta_trust_mean(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
|
| 23 |
+
alpha_post = alpha_0 + float(successes)
|
| 24 |
+
beta_post = beta_0 + float(failures)
|
| 25 |
+
return float(alpha_post / (alpha_post + beta_post))
|
| 26 |
+
|
| 27 |
+
|
| 28 |
+
def beta_trust_var(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
|
| 29 |
+
alpha_post = alpha_0 + float(successes)
|
| 30 |
+
beta_post = beta_0 + float(failures)
|
| 31 |
+
total = alpha_post + beta_post
|
| 32 |
+
return float((alpha_post * beta_post) / ((total ** 2) * (total + 1.0)))
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
def beta_trust_std(successes: int, failures: int, alpha_0: float = 3.0, beta_0: float = 1.0) -> float:
|
| 36 |
+
return float(math.sqrt(beta_trust_var(successes, failures, alpha_0, beta_0)))
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
def beta_lcb(
|
| 40 |
+
successes: int,
|
| 41 |
+
failures: int,
|
| 42 |
+
lambda_risk: float = 1.0,
|
| 43 |
+
alpha_0: float = 3.0,
|
| 44 |
+
beta_0: float = 1.0,
|
| 45 |
+
) -> float:
|
| 46 |
+
mu = beta_trust_mean(successes, failures, alpha_0, beta_0)
|
| 47 |
+
sigma = beta_trust_std(successes, failures, alpha_0, beta_0)
|
| 48 |
+
score = mu - (lambda_risk * sigma)
|
| 49 |
+
return float(max(0.0, min(1.0, score)))
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
def posterior_probability_reliable(
|
| 53 |
+
successes: int,
|
| 54 |
+
failures: int,
|
| 55 |
+
threshold: float = 0.70,
|
| 56 |
+
alpha_0: float = 3.0,
|
| 57 |
+
beta_0: float = 1.0,
|
| 58 |
+
) -> float:
|
| 59 |
+
alpha_post = alpha_0 + float(successes)
|
| 60 |
+
beta_post = beta_0 + float(failures)
|
| 61 |
+
cdf_at_thresh = float(sc.betainc(alpha_post, beta_post, threshold))
|
| 62 |
+
return float(max(0.0, min(1.0, 1.0 - cdf_at_thresh)))
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
def should_quarantine(
|
| 66 |
+
successes: int,
|
| 67 |
+
failures: int,
|
| 68 |
+
gamma: float = 0.05,
|
| 69 |
+
threshold: float = 0.70,
|
| 70 |
+
alpha_0: float = 3.0,
|
| 71 |
+
beta_0: float = 1.0,
|
| 72 |
+
) -> bool:
|
| 73 |
+
prob = posterior_probability_reliable(successes, failures, threshold, alpha_0, beta_0)
|
| 74 |
+
return prob < gamma
|
| 75 |
+
|
| 76 |
+
|
| 77 |
+
def compute_consecutive_failure_series(
|
| 78 |
+
alpha_0: float = 3.0,
|
| 79 |
+
beta_0: float = 1.0,
|
| 80 |
+
gamma: float = 0.05,
|
| 81 |
+
threshold: float = 0.70,
|
| 82 |
+
max_steps: int = 6,
|
| 83 |
+
) -> pd.DataFrame:
|
| 84 |
+
rows = []
|
| 85 |
+
for t in range(0, max_steps + 1):
|
| 86 |
+
alpha_post = alpha_0
|
| 87 |
+
beta_post = beta_0 + float(t)
|
| 88 |
+
mu = alpha_post / (alpha_post + beta_post)
|
| 89 |
+
std = math.sqrt((alpha_post * beta_post) / (((alpha_post + beta_post) ** 2) * (alpha_post + beta_post + 1.0)))
|
| 90 |
+
p_rel = posterior_probability_reliable(0, t, threshold, alpha_0, beta_0)
|
| 91 |
+
is_q = p_rel < gamma
|
| 92 |
+
status = "QUARANTINED (Threshold Triggered)" if is_q else "ACTIVE (Admissible)"
|
| 93 |
+
rows.append({
|
| 94 |
+
"Consecutive Failures (t)": t,
|
| 95 |
+
"Posterior Beta": f"Beta({alpha_post:.1f}, {beta_post:.1f})",
|
| 96 |
+
"Posterior Mean E[theta]": f"{mu:.4f}",
|
| 97 |
+
"Uncertainty (sigma)": f"{std:.4f}",
|
| 98 |
+
"P(theta > 0.70)": f"{p_rel * 100:.2f}%",
|
| 99 |
+
"Quarantine Status": status,
|
| 100 |
+
})
|
| 101 |
+
return pd.DataFrame(rows)
|
| 102 |
+
|
| 103 |
+
|
| 104 |
+
# --- Visualizers ---
|
| 105 |
+
|
| 106 |
+
def plot_beta_posterior(
|
| 107 |
+
alpha_0: float,
|
| 108 |
+
beta_0: float,
|
| 109 |
+
successes: int,
|
| 110 |
+
failures: int,
|
| 111 |
+
lambda_risk: float,
|
| 112 |
+
threshold: float,
|
| 113 |
+
gamma: float,
|
| 114 |
+
) -> Tuple[go.Figure, str, str, str, str, str]:
|
| 115 |
+
alpha_post = alpha_0 + float(successes)
|
| 116 |
+
beta_post = beta_0 + float(failures)
|
| 117 |
+
mu = beta_trust_mean(successes, failures, alpha_0, beta_0)
|
| 118 |
+
std = beta_trust_std(successes, failures, alpha_0, beta_0)
|
| 119 |
+
lcb_val = beta_lcb(successes, failures, lambda_risk, alpha_0, beta_0)
|
| 120 |
+
p_rel = posterior_probability_reliable(successes, failures, threshold, alpha_0, beta_0)
|
| 121 |
+
is_quarantined = p_rel < gamma
|
| 122 |
+
|
| 123 |
+
x = np.linspace(0.001, 0.999, 600)
|
| 124 |
+
y = stats.beta.pdf(x, alpha_post, beta_post)
|
| 125 |
+
|
| 126 |
+
fig = go.Figure()
|
| 127 |
+
|
| 128 |
+
# Prior curve for visual comparison
|
| 129 |
+
y_prior = stats.beta.pdf(x, alpha_0, beta_0)
|
| 130 |
+
fig.add_trace(go.Scatter(
|
| 131 |
+
x=x,
|
| 132 |
+
y=y_prior,
|
| 133 |
+
mode="lines",
|
| 134 |
+
line=dict(color="rgba(140, 140, 140, 0.6)", width=1.5, dash="dash"),
|
| 135 |
+
name=f"Prior Beta({alpha_0:.1f}, {beta_0:.1f})",
|
| 136 |
+
))
|
| 137 |
+
|
| 138 |
+
# Posterior curve
|
| 139 |
+
fig.add_trace(go.Scatter(
|
| 140 |
+
x=x,
|
| 141 |
+
y=y,
|
| 142 |
+
mode="lines",
|
| 143 |
+
line=dict(color="#2563eb", width=3),
|
| 144 |
+
name=f"Posterior Beta({alpha_post:.1f}, {beta_post:.1f})",
|
| 145 |
+
))
|
| 146 |
+
|
| 147 |
+
# Shading for Reliable region (theta >= threshold)
|
| 148 |
+
x_rel = x[x >= threshold]
|
| 149 |
+
y_rel = y[x >= threshold]
|
| 150 |
+
if len(x_rel) > 0:
|
| 151 |
+
fig.add_trace(go.Scatter(
|
| 152 |
+
x=np.concatenate([[threshold], x_rel, [x_rel[-1]]]),
|
| 153 |
+
y=np.concatenate([[0], y_rel, [0]]),
|
| 154 |
+
fill="toself",
|
| 155 |
+
fillcolor="rgba(34, 197, 94, 0.25)",
|
| 156 |
+
line=dict(color="rgba(255,255,255,0)"),
|
| 157 |
+
name=f"Admissible Region (P={p_rel*100:.1f}%)",
|
| 158 |
+
hoverinfo="skip",
|
| 159 |
+
))
|
| 160 |
+
|
| 161 |
+
# Vertical reference lines
|
| 162 |
+
max_y = float(np.max(y)) * 1.05 if np.max(y) > 0 else 5.0
|
| 163 |
+
|
| 164 |
+
# Operational threshold line
|
| 165 |
+
fig.add_vline(
|
| 166 |
+
x=threshold,
|
| 167 |
+
line=dict(color="#ef4444", width=2, dash="dash"),
|
| 168 |
+
annotation_text=f"Admissibility Threshold ({threshold:.2f})",
|
| 169 |
+
annotation_position="top left",
|
| 170 |
+
)
|
| 171 |
+
|
| 172 |
+
# Posterior mean line
|
| 173 |
+
fig.add_vline(
|
| 174 |
+
x=mu,
|
| 175 |
+
line=dict(color="#2563eb", width=2),
|
| 176 |
+
annotation_text=f"Mean E[theta]={mu:.3f}",
|
| 177 |
+
annotation_position="top right",
|
| 178 |
+
)
|
| 179 |
+
|
| 180 |
+
# LCB line
|
| 181 |
+
fig.add_vline(
|
| 182 |
+
x=lcb_val,
|
| 183 |
+
line=dict(color="#8b5cf6", width=2, dash="dot"),
|
| 184 |
+
annotation_text=f"LCB(lambda={lambda_risk:.1f})={lcb_val:.3f}",
|
| 185 |
+
annotation_position="bottom left",
|
| 186 |
+
)
|
| 187 |
+
|
| 188 |
+
fig.update_layout(
|
| 189 |
+
title=dict(
|
| 190 |
+
text=f"Posterior Reliability Distribution: Beta({alpha_post:.1f}, {beta_post:.1f}) vs Prior Beta({alpha_0:.1f}, {beta_0:.1f})",
|
| 191 |
+
font=dict(size=15),
|
| 192 |
+
),
|
| 193 |
+
xaxis=dict(title="True Latent Reliability theta in [0, 1]", range=[0.0, 1.0], gridcolor="#e5e7eb"),
|
| 194 |
+
yaxis=dict(title="Probability Density f(theta)", range=[0.0, max_y], gridcolor="#e5e7eb"),
|
| 195 |
+
template="plotly_white",
|
| 196 |
+
margin=dict(l=40, r=40, t=50, b=40),
|
| 197 |
+
legend=dict(orientation="h", yanchor="bottom", y=1.02, xanchor="right", x=1.0),
|
| 198 |
+
)
|
| 199 |
+
|
| 200 |
+
status_str = "QUARANTINED (Pruned from Retrieval)" if is_quarantined else "ACTIVE (Admissible for Retrieval)"
|
| 201 |
+
status_bg = "#fee2e2" if is_quarantined else "#dcfce7"
|
| 202 |
+
status_text_color = "#991b1b" if is_quarantined else "#166534"
|
| 203 |
+
status_card = (
|
| 204 |
+
f"<div style='padding: 12px 18px; border-radius: 8px; background-color: {status_bg}; "
|
| 205 |
+
f"color: {status_text_color}; font-weight: 600; font-size: 16px; border: 1px solid {status_text_color};'>"
|
| 206 |
+
f"Operational Status: {status_str}</div>"
|
| 207 |
+
)
|
| 208 |
+
|
| 209 |
+
metric_mean = f"{mu:.4f}"
|
| 210 |
+
metric_sigma = f"{std:.4f}"
|
| 211 |
+
metric_lcb = f"{lcb_val:.4f}"
|
| 212 |
+
metric_prob = f"{p_rel * 100:.2f}%"
|
| 213 |
+
|
| 214 |
+
return fig, status_card, metric_mean, metric_sigma, metric_lcb, metric_prob
|
| 215 |
+
|
| 216 |
+
|
| 217 |
+
# --- Retrieval Simulation Data ---
|
| 218 |
+
|
| 219 |
+
SAMPLE_MEMORIES = [
|
| 220 |
+
{
|
| 221 |
+
"id": "MEM-CORRUPT-01",
|
| 222 |
+
"domain": "coding",
|
| 223 |
+
"lesson": "Use global shared state across async workers without mutex lock for throughput.",
|
| 224 |
+
"cosine_sim": 0.94,
|
| 225 |
+
"successes": 2,
|
| 226 |
+
"failures": 5,
|
| 227 |
+
"note": "Corrupted/stale reflection causing race condition deadlocks.",
|
| 228 |
+
},
|
| 229 |
+
{
|
| 230 |
+
"id": "MEM-ROBUST-02",
|
| 231 |
+
"domain": "coding",
|
| 232 |
+
"lesson": "Implement asyncio.Lock with timeout fallback and circuit breaker isolation.",
|
| 233 |
+
"cosine_sim": 0.83,
|
| 234 |
+
"successes": 22,
|
| 235 |
+
"failures": 1,
|
| 236 |
+
"note": "High empirical validation under stress tests.",
|
| 237 |
+
},
|
| 238 |
+
{
|
| 239 |
+
"id": "MEM-UNTESTED-03",
|
| 240 |
+
"domain": "coding",
|
| 241 |
+
"lesson": "Refactor threading pool to use separate child process queues.",
|
| 242 |
+
"cosine_sim": 0.89,
|
| 243 |
+
"successes": 0,
|
| 244 |
+
"failures": 0,
|
| 245 |
+
"note": "Newly distilled reflection with zero empirical execution history.",
|
| 246 |
+
},
|
| 247 |
+
{
|
| 248 |
+
"id": "MEM-MARGINAL-04",
|
| 249 |
+
"domain": "coding",
|
| 250 |
+
"lesson": "Log execution traceback to local scratch buffer before propagating exceptions.",
|
| 251 |
+
"cosine_sim": 0.65,
|
| 252 |
+
"successes": 15,
|
| 253 |
+
"failures": 2,
|
| 254 |
+
"note": "Low direct task relevance, but high historical reliability.",
|
| 255 |
+
},
|
| 256 |
+
]
|
| 257 |
+
|
| 258 |
+
|
| 259 |
+
def evaluate_retrieval_ranking(lambda_risk: float, alpha_0: float = 3.0, beta_0: float = 1.0) -> pd.DataFrame:
|
| 260 |
+
rows = []
|
| 261 |
+
for m in SAMPLE_MEMORIES:
|
| 262 |
+
ns = m["successes"]
|
| 263 |
+
nf = m["failures"]
|
| 264 |
+
sim = m["cosine_sim"]
|
| 265 |
+
mu = beta_trust_mean(ns, nf, alpha_0, beta_0)
|
| 266 |
+
std = beta_trust_std(ns, nf, alpha_0, beta_0)
|
| 267 |
+
lcb_score = beta_lcb(ns, nf, lambda_risk, alpha_0, beta_0)
|
| 268 |
+
p_rel = posterior_probability_reliable(ns, nf, 0.70, alpha_0, beta_0)
|
| 269 |
+
is_q = should_quarantine(ns, nf, 0.05, 0.70, alpha_0, beta_0)
|
| 270 |
+
|
| 271 |
+
naive_score = sim
|
| 272 |
+
composite_score = 0.0 if is_q else sim * lcb_score
|
| 273 |
+
|
| 274 |
+
rows.append({
|
| 275 |
+
"Memory ID": m["id"],
|
| 276 |
+
"Cosine Sim": sim,
|
| 277 |
+
"Successes (ns)": ns,
|
| 278 |
+
"Failures (nf)": nf,
|
| 279 |
+
"Posterior Mean E[theta]": round(mu, 3),
|
| 280 |
+
"Uncertainty (sigma)": round(std, 3),
|
| 281 |
+
"LCB Score": round(lcb_score, 3),
|
| 282 |
+
"Naive Retrieval Score": round(naive_score, 3),
|
| 283 |
+
"Pessimistic LCB Composite": round(composite_score, 3),
|
| 284 |
+
"Quarantine": "QUARANTINED" if is_q else "ACTIVE",
|
| 285 |
+
"Strategy Directives": m["lesson"],
|
| 286 |
+
})
|
| 287 |
+
|
| 288 |
+
df = pd.DataFrame(rows)
|
| 289 |
+
# Sort primarily by proposed composite score descending
|
| 290 |
+
df = df.sort_values(by="Pessimistic LCB Composite", ascending=False).reset_index(drop=True)
|
| 291 |
+
df.insert(0, "LCB Rank", [f"#{i+1}" for i in range(len(df))])
|
| 292 |
+
return df
|
| 293 |
+
|
| 294 |
+
|
| 295 |
+
# --- Load Real Benchmark Data for Explorer ---
|
| 296 |
+
|
| 297 |
+
DATA_DIR = Path(__file__).parent / "data"
|
| 298 |
+
|
| 299 |
+
def load_benchmark_summary() -> Tuple[pd.DataFrame, pd.DataFrame]:
|
| 300 |
+
traces_path = DATA_DIR / "telemetry_traces.csv"
|
| 301 |
+
mem_path = DATA_DIR / "memory_bank_experiences.csv"
|
| 302 |
+
|
| 303 |
+
if traces_path.exists():
|
| 304 |
+
df_traces = pd.read_csv(traces_path)
|
| 305 |
+
summary = (
|
| 306 |
+
df_traces.groupby("ablation_condition")
|
| 307 |
+
.agg(
|
| 308 |
+
Total_Steps=("step_index", "count"),
|
| 309 |
+
Accuracy=("task_success", "mean"),
|
| 310 |
+
Avg_Reward=("observed_reward", "mean"),
|
| 311 |
+
Mean_Similarity=("cosine_similarity", "mean"),
|
| 312 |
+
Quarantine_Triggers=("quarantine_triggered", "sum"),
|
| 313 |
+
)
|
| 314 |
+
.reset_index()
|
| 315 |
+
)
|
| 316 |
+
summary["Accuracy"] = summary["Accuracy"].apply(lambda v: f"{v * 100:.2f}%")
|
| 317 |
+
summary["Avg_Reward"] = summary["Avg_Reward"].apply(lambda v: f"{v:.3f}")
|
| 318 |
+
summary["Mean_Similarity"] = summary["Mean_Similarity"].apply(lambda v: f"{v:.3f}")
|
| 319 |
+
else:
|
| 320 |
+
summary = pd.DataFrame({"Notice": ["telemetry_traces.csv not found locally."]})
|
| 321 |
+
|
| 322 |
+
if mem_path.exists():
|
| 323 |
+
df_mem = pd.read_csv(mem_path)
|
| 324 |
+
mem_preview = df_mem[[
|
| 325 |
+
"experience_id", "task_domain", "successes_count", "failures_count",
|
| 326 |
+
"posterior_mean_trust", "posterior_variance", "pessimistic_lcb_score",
|
| 327 |
+
"quarantine_status", "is_adversarial_sample"
|
| 328 |
+
]].head(25)
|
| 329 |
+
else:
|
| 330 |
+
mem_preview = pd.DataFrame({"Notice": ["memory_bank_experiences.csv not found locally."]})
|
| 331 |
+
|
| 332 |
+
return summary, mem_preview
|
| 333 |
+
|
| 334 |
+
|
| 335 |
+
# --- Gradio Application Layout ---
|
| 336 |
+
|
| 337 |
+
def build_app() -> gr.Blocks:
|
| 338 |
+
theme = gr.themes.Soft(
|
| 339 |
+
primary_hue="blue",
|
| 340 |
+
neutral_hue="slate",
|
| 341 |
+
)
|
| 342 |
+
|
| 343 |
+
with gr.Blocks(title="Adaptive Agent Memory Resilience Playground") as demo:
|
| 344 |
+
gr.Markdown(
|
| 345 |
+
"""
|
| 346 |
+
# Adaptive Agent Memory Resilience Playground
|
| 347 |
+
### Mathematical Trust Dynamics & Pessimistic LCB Memory Retrieval for Autonomous LLM Agents
|
| 348 |
+
**Author:** Sumit Das (`@sumitaidev`) | Research Paper Pre-print (2026) | [Benchmark Dataset](https://huggingface.co/datasets/sumitaidev/agent-memory-resilience-benchmark)
|
| 349 |
+
|
| 350 |
+
This research tool allows AI researchers and engineers to interactively analyze how Bayesian conjugate updating,
|
| 351 |
+
epistemic variance quantification, and pessimistic Lower Confidence Bound (LCB) composite retrieval prevent
|
| 352 |
+
**Negative Transfer** and **Memory Poisoning** in agent systems (such as LangGraph, AutoGen, and CrewAI).
|
| 353 |
+
"""
|
| 354 |
+
)
|
| 355 |
+
|
| 356 |
+
with gr.Tabs():
|
| 357 |
+
# TAB 1: Bayesian Reliability & Quarantine Engine
|
| 358 |
+
with gr.TabItem("1. Bayesian Reliability & Theorem 1"):
|
| 359 |
+
gr.Markdown(
|
| 360 |
+
"""
|
| 361 |
+
### Conjugate Beta-Bernoulli Posterior Update Engine
|
| 362 |
+
Simulates task trials for an individual experiential memory record under weakly-informative prior $\\operatorname{Beta}(\\alpha_0=3.0, \\beta_0=1.0)$.
|
| 363 |
+
Theorem 1 states that at operational threshold $\\theta=0.70$ and significance $\\gamma=0.05$, exactly $t^* = 4$ consecutive failures triggers deterministic quarantine.
|
| 364 |
+
"""
|
| 365 |
+
)
|
| 366 |
+
with gr.Row():
|
| 367 |
+
with gr.Column(scale=1):
|
| 368 |
+
alpha_0_input = gr.Slider(0.5, 10.0, value=3.0, step=0.5, label="Prior Alpha (alpha_0)")
|
| 369 |
+
beta_0_input = gr.Slider(0.5, 10.0, value=1.0, step=0.5, label="Prior Beta (beta_0)")
|
| 370 |
+
successes_input = gr.Slider(0, 50, value=0, step=1, label="Observed Task Successes (n_s)")
|
| 371 |
+
failures_input = gr.Slider(0, 20, value=0, step=1, label="Observed Task Failures (n_f)")
|
| 372 |
+
lambda_input = gr.Slider(0.0, 3.0, value=1.0, step=0.2, label="Risk Aversion Parameter (lambda)")
|
| 373 |
+
threshold_input = gr.Slider(0.5, 0.9, value=0.70, step=0.05, label="Admissibility Standard (threshold)")
|
| 374 |
+
gamma_input = gr.Slider(0.01, 0.20, value=0.05, step=0.01, label="Quarantine Significance Level (gamma)")
|
| 375 |
+
|
| 376 |
+
status_html = gr.HTML()
|
| 377 |
+
|
| 378 |
+
with gr.Column(scale=2):
|
| 379 |
+
with gr.Row():
|
| 380 |
+
mean_kpi = gr.Textbox(label="Posterior Mean E[theta]", interactive=False)
|
| 381 |
+
sigma_kpi = gr.Textbox(label="Uncertainty (sigma)", interactive=False)
|
| 382 |
+
lcb_kpi = gr.Textbox(label="LCB Score", interactive=False)
|
| 383 |
+
prob_kpi = gr.Textbox(label="P(theta > threshold)", interactive=False)
|
| 384 |
+
|
| 385 |
+
plot_output = gr.Plot(label="Posterior Reliability Distribution")
|
| 386 |
+
|
| 387 |
+
gr.Markdown("#### Theorem 1 Deterministic Verification: Consecutive Failure Trajectory")
|
| 388 |
+
theorem_table = gr.Dataframe(
|
| 389 |
+
headers=["Consecutive Failures (t)", "Posterior Beta", "Posterior Mean E[theta]", "Uncertainty (sigma)", "P(theta > 0.70)", "Quarantine Status"],
|
| 390 |
+
interactive=False,
|
| 391 |
+
)
|
| 392 |
+
|
| 393 |
+
def update_tab1(a0, b0, ns, nf, lam, thresh, gam):
|
| 394 |
+
fig, card, m_val, s_val, lcb_val, p_val = plot_beta_posterior(
|
| 395 |
+
a0, b0, int(ns), int(nf), lam, thresh, gam
|
| 396 |
+
)
|
| 397 |
+
th_df = compute_consecutive_failure_series(a0, b0, gam, thresh)
|
| 398 |
+
return fig, card, m_val, s_val, lcb_val, p_val, th_df
|
| 399 |
+
|
| 400 |
+
inputs_tab1 = [alpha_0_input, beta_0_input, successes_input, failures_input, lambda_input, threshold_input, gamma_input]
|
| 401 |
+
outputs_tab1 = [plot_output, status_html, mean_kpi, sigma_kpi, lcb_kpi, prob_kpi, theorem_table]
|
| 402 |
+
|
| 403 |
+
for comp in inputs_tab1:
|
| 404 |
+
comp.change(fn=update_tab1, inputs=inputs_tab1, outputs=outputs_tab1)
|
| 405 |
+
|
| 406 |
+
demo.load(fn=update_tab1, inputs=inputs_tab1, outputs=outputs_tab1)
|
| 407 |
+
|
| 408 |
+
# TAB 2: Retrieval Ranking Playground
|
| 409 |
+
with gr.TabItem("2. Pessimistic LCB Memory Retrieval"):
|
| 410 |
+
gr.Markdown(
|
| 411 |
+
"""
|
| 412 |
+
### Retrieval Competition: Naive Cosine Similarity vs Pessimistic LCB
|
| 413 |
+
Demonstrates how standard vector RAG repeatedly retrieves corrupted memories with high semantic similarity,
|
| 414 |
+
causing catastrophic cascade failures. Our composite formulation:
|
| 415 |
+
$$\\operatorname{Score}(e; q) = \\operatorname{Sim}(\\mathbf{q}, \\mathbf{v}_e) \\times \\operatorname{LCB}_\\lambda(e)$$
|
| 416 |
+
penalizes uncertain reflections and quarantines verified failures.
|
| 417 |
+
"""
|
| 418 |
+
)
|
| 419 |
+
with gr.Row():
|
| 420 |
+
retrieval_lambda = gr.Slider(0.0, 3.0, value=1.0, step=0.25, label="Risk Aversion Parameter (lambda)")
|
| 421 |
+
refresh_retrieval_btn = gr.Button("Recompute Rankings")
|
| 422 |
+
|
| 423 |
+
retrieval_table = gr.Dataframe(interactive=False)
|
| 424 |
+
|
| 425 |
+
gr.Markdown(
|
| 426 |
+
"""
|
| 427 |
+
**Key Analytical Observations**:
|
| 428 |
+
- At $\\lambda = 0.0$ (Risk-neutral/Naive Cosine): `MEM-CORRUPT-01` ranks #1 because its cosine similarity is 0.94.
|
| 429 |
+
- At $\\lambda \\ge 1.0$ (Pessimistic LCB): `MEM-CORRUPT-01` is flagged for quarantine, and `MEM-ROBUST-02` (proven with 22 successes) rightfully takes #1 rank.
|
| 430 |
+
- `MEM-UNTESTED-03` with 0 executions receives an uncertainty penalty, preventing the agent from blindly over-trusting unvalidated reflections.
|
| 431 |
+
"""
|
| 432 |
+
)
|
| 433 |
+
|
| 434 |
+
def update_retrieval(lam):
|
| 435 |
+
return evaluate_retrieval_ranking(lam)
|
| 436 |
+
|
| 437 |
+
retrieval_lambda.change(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
|
| 438 |
+
refresh_retrieval_btn.click(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
|
| 439 |
+
demo.load(fn=update_retrieval, inputs=[retrieval_lambda], outputs=[retrieval_table])
|
| 440 |
+
|
| 441 |
+
# TAB 3: Benchmark Traces & Empirical Results
|
| 442 |
+
with gr.TabItem("3. Benchmark Traces & Ablation"):
|
| 443 |
+
gr.Markdown(
|
| 444 |
+
"""
|
| 445 |
+
### Empirical Benchmark Telemetry Summary (1,200 Execution Steps)
|
| 446 |
+
Comparative performance across four controlled experimental conditions under adversarial noise injection (steps 60 to 140).
|
| 447 |
+
"""
|
| 448 |
+
)
|
| 449 |
+
summary_df, preview_df = load_benchmark_summary()
|
| 450 |
+
|
| 451 |
+
gr.Markdown("#### Ablation Conditions Summary")
|
| 452 |
+
gr.Dataframe(value=summary_df, interactive=False)
|
| 453 |
+
|
| 454 |
+
gr.Markdown("#### Experiential Memory Bank Sample (100 Verified Records)")
|
| 455 |
+
gr.Dataframe(value=preview_df, interactive=False)
|
| 456 |
+
|
| 457 |
+
gr.Markdown(
|
| 458 |
+
"""
|
| 459 |
+
### Citation
|
| 460 |
+
```bibtex
|
| 461 |
+
@article{das2026adaptive,
|
| 462 |
+
title={Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval},
|
| 463 |
+
author={Das, Sumit},
|
| 464 |
+
journal={arXiv preprint},
|
| 465 |
+
year={2026}
|
| 466 |
+
}
|
| 467 |
+
```
|
| 468 |
+
"""
|
| 469 |
+
)
|
| 470 |
+
|
| 471 |
+
return demo
|
| 472 |
+
|
| 473 |
+
|
| 474 |
+
if __name__ == "__main__":
|
| 475 |
+
app = build_app()
|
| 476 |
+
app.launch(theme=gr.themes.Soft(primary_hue="blue", neutral_hue="slate"))
|
data/memory_bank_experiences.csv
ADDED
|
@@ -0,0 +1,101 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
experience_id,task_domain,trigger_condition,strategy_lesson,negative_pitfall,initial_confidence,successes_count,failures_count,total_uses,posterior_mean_trust,posterior_variance,pessimistic_lcb_score,quarantine_status,is_adversarial_sample
|
| 2 |
+
exp_0001,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.91,4,4,8,0.5833,0.018697,0.4466,active,False
|
| 3 |
+
exp_0002,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.823,6,0,6,0.9,0.008182,0.8095,active,False
|
| 4 |
+
exp_0003,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.89,2,2,4,0.625,0.026042,0.4636,active,False
|
| 5 |
+
exp_0004,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.945,7,0,7,0.9091,0.006887,0.8261,active,False
|
| 6 |
+
exp_0005,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.827,10,0,10,0.9286,0.004422,0.8621,active,False
|
| 7 |
+
exp_0006,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.879,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 8 |
+
exp_0007,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.892,0,4,4,0.375,0.026042,0.2136,deprecated,True
|
| 9 |
+
exp_0008,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.855,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 10 |
+
exp_0009,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.83,4,2,6,0.7,0.019091,0.5618,active,False
|
| 11 |
+
exp_0010,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.807,5,1,6,0.8,0.014545,0.6794,active,False
|
| 12 |
+
exp_0011,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.81,6,0,6,0.9,0.008182,0.8095,active,False
|
| 13 |
+
exp_0012,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.921,15,4,19,0.7826,0.007089,0.6984,active,False
|
| 14 |
+
exp_0013,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.903,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 15 |
+
exp_0014,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.874,0,3,3,0.4286,0.030612,0.2536,active,True
|
| 16 |
+
exp_0015,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.839,2,3,5,0.5556,0.024691,0.3984,active,False
|
| 17 |
+
exp_0016,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.878,6,0,6,0.9,0.008182,0.8095,active,False
|
| 18 |
+
exp_0017,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.945,5,0,5,0.8889,0.009877,0.7895,active,False
|
| 19 |
+
exp_0018,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.934,8,4,12,0.6875,0.012638,0.5751,active,False
|
| 20 |
+
exp_0019,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.813,6,3,9,0.6923,0.015216,0.569,active,False
|
| 21 |
+
exp_0020,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.849,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 22 |
+
exp_0021,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.924,0,4,4,0.375,0.026042,0.2136,deprecated,True
|
| 23 |
+
exp_0022,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.881,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 24 |
+
exp_0023,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.811,2,2,4,0.625,0.026042,0.4636,active,False
|
| 25 |
+
exp_0024,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.83,21,2,23,0.8889,0.003527,0.8295,active,False
|
| 26 |
+
exp_0025,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.906,2,2,4,0.625,0.026042,0.4636,active,False
|
| 27 |
+
exp_0026,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.811,7,2,9,0.7692,0.01268,0.6566,active,False
|
| 28 |
+
exp_0027,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.929,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 29 |
+
exp_0028,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.81,1,4,5,0.4444,0.024691,0.2873,active,True
|
| 30 |
+
exp_0029,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.909,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 31 |
+
exp_0030,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.871,6,3,9,0.6923,0.015216,0.569,active,False
|
| 32 |
+
exp_0031,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.914,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 33 |
+
exp_0032,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.874,5,2,7,0.7273,0.016529,0.5987,active,False
|
| 34 |
+
exp_0033,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.804,5,0,5,0.8889,0.009877,0.7895,active,False
|
| 35 |
+
exp_0034,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.895,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 36 |
+
exp_0035,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.936,0,6,6,0.3,0.019091,0.1618,deprecated,True
|
| 37 |
+
exp_0036,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.913,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 38 |
+
exp_0037,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.843,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 39 |
+
exp_0038,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.921,2,3,5,0.5556,0.024691,0.3984,active,False
|
| 40 |
+
exp_0039,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.921,6,2,8,0.75,0.014423,0.6299,active,False
|
| 41 |
+
exp_0040,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.881,2,3,5,0.5556,0.024691,0.3984,active,False
|
| 42 |
+
exp_0041,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.848,9,3,12,0.75,0.011029,0.645,active,False
|
| 43 |
+
exp_0042,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.864,0,4,4,0.375,0.026042,0.2136,deprecated,True
|
| 44 |
+
exp_0043,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.801,9,2,11,0.8,0.01,0.7,active,False
|
| 45 |
+
exp_0044,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.833,5,0,5,0.8889,0.009877,0.7895,active,False
|
| 46 |
+
exp_0045,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.941,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 47 |
+
exp_0046,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.905,3,1,4,0.75,0.020833,0.6057,active,False
|
| 48 |
+
exp_0047,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.944,4,5,9,0.5385,0.017751,0.4052,active,False
|
| 49 |
+
exp_0048,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.845,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 50 |
+
exp_0049,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.891,0,3,3,0.4286,0.030612,0.2536,active,True
|
| 51 |
+
exp_0050,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.842,5,0,5,0.8889,0.009877,0.7895,active,False
|
| 52 |
+
exp_0051,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.822,12,0,12,0.9375,0.003447,0.8788,active,False
|
| 53 |
+
exp_0052,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.836,5,6,11,0.5333,0.015556,0.4086,active,False
|
| 54 |
+
exp_0053,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.836,6,2,8,0.75,0.014423,0.6299,active,False
|
| 55 |
+
exp_0054,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.895,7,0,7,0.9091,0.006887,0.8261,active,False
|
| 56 |
+
exp_0055,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.814,6,1,7,0.8182,0.012397,0.7068,active,False
|
| 57 |
+
exp_0056,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.828,1,4,5,0.4444,0.024691,0.2873,active,True
|
| 58 |
+
exp_0057,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.902,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 59 |
+
exp_0058,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.834,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 60 |
+
exp_0059,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.904,6,0,6,0.9,0.008182,0.8095,active,False
|
| 61 |
+
exp_0060,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.821,4,3,7,0.6364,0.019284,0.4975,active,False
|
| 62 |
+
exp_0061,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.939,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 63 |
+
exp_0062,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.899,11,0,11,0.9333,0.003889,0.871,active,False
|
| 64 |
+
exp_0063,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.879,1,6,7,0.3636,0.019284,0.2248,deprecated,True
|
| 65 |
+
exp_0064,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.935,3,0,3,0.8571,0.015306,0.7334,active,False
|
| 66 |
+
exp_0065,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.851,12,1,13,0.8824,0.005767,0.8064,active,False
|
| 67 |
+
exp_0066,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.935,3,1,4,0.75,0.020833,0.6057,active,False
|
| 68 |
+
exp_0067,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.896,11,2,13,0.8235,0.008074,0.7337,active,False
|
| 69 |
+
exp_0068,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.935,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 70 |
+
exp_0069,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.815,6,0,6,0.9,0.008182,0.8095,active,False
|
| 71 |
+
exp_0070,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.824,1,3,4,0.5,0.027778,0.3333,active,True
|
| 72 |
+
exp_0071,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.898,5,1,6,0.8,0.014545,0.6794,active,False
|
| 73 |
+
exp_0072,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.836,3,1,4,0.75,0.020833,0.6057,active,False
|
| 74 |
+
exp_0073,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.897,3,1,4,0.75,0.020833,0.6057,active,False
|
| 75 |
+
exp_0074,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.885,10,1,11,0.8667,0.007222,0.7817,active,False
|
| 76 |
+
exp_0075,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.84,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 77 |
+
exp_0076,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.859,3,5,8,0.5,0.019231,0.3613,active,False
|
| 78 |
+
exp_0077,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.919,2,7,9,0.3846,0.016906,0.2546,deprecated,True
|
| 79 |
+
exp_0078,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.874,5,1,6,0.8,0.014545,0.6794,active,False
|
| 80 |
+
exp_0079,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.842,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 81 |
+
exp_0080,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.827,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 82 |
+
exp_0081,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.937,14,4,18,0.7727,0.007636,0.6853,active,False
|
| 83 |
+
exp_0082,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.939,4,0,4,0.875,0.012153,0.7648,active,False
|
| 84 |
+
exp_0083,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.945,4,4,8,0.5833,0.018697,0.4466,active,False
|
| 85 |
+
exp_0084,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.858,2,4,6,0.5,0.022727,0.3492,active,True
|
| 86 |
+
exp_0085,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.825,10,0,10,0.9286,0.004422,0.8621,active,False
|
| 87 |
+
exp_0086,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.904,5,3,8,0.6667,0.017094,0.5359,active,False
|
| 88 |
+
exp_0087,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.892,5,0,5,0.8889,0.009877,0.7895,active,False
|
| 89 |
+
exp_0088,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.878,22,0,22,0.9615,0.00137,0.9245,active,False
|
| 90 |
+
exp_0089,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.905,11,1,12,0.875,0.006434,0.7948,active,False
|
| 91 |
+
exp_0090,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.844,7,0,7,0.9091,0.006887,0.8261,active,False
|
| 92 |
+
exp_0091,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.93,1,10,11,0.2667,0.012222,0.1561,deprecated,True
|
| 93 |
+
exp_0092,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.875,12,1,13,0.8824,0.005767,0.8064,active,False
|
| 94 |
+
exp_0093,research,Adversarial prompt injection in tool execution parameters,Enforce strict Pydantic JSON schema validation and sanitize tool inputs.,Do not permit arbitrary shell command execution from raw LLM outputs.,0.905,9,1,10,0.8571,0.008163,0.7668,active,False
|
| 95 |
+
exp_0094,analysis,Partition pruning failure on date-partitioned BigQuery tables,Specify explicit partition filters in WHERE clauses before join projection.,Avoid dynamic SQL expressions that bypass query optimizer partition pruning.,0.851,9,3,12,0.75,0.011029,0.645,active,False
|
| 96 |
+
exp_0095,planning,Catastrophic forgetting during multi-turn reflection updates,Maintain conjugate Beta posterior tracking with pessimistic LCB retrieval.,Never use uncalibrated symmetric EMA that permits negative transfer.,0.887,4,0,4,0.875,0.012153,0.7648,active,False
|
| 97 |
+
exp_0096,coding,Distributed PyTorch GPU OOM during backward pass,Apply gradient accumulation and activate activation checkpointing.,Do not blindly increase batch size without profiling memory overhead.,0.881,2,0,2,0.8333,0.019841,0.6925,active,False
|
| 98 |
+
exp_0097,research,Conflicting scientific claims regarding carbon capture efficiency,Cross-reference source methodology and normalize baseline parameters.,Avoid citing unverified preprint summaries lacking methodology disclosures.,0.805,3,1,4,0.75,0.020833,0.6057,active,False
|
| 99 |
+
exp_0098,analysis,Vector index latency spikes under high query concurrency,Implement HNSW index quantization with IVFPQ compression.,Do not disable index caching on read-heavy production query routes.,0.854,0,10,10,0.2143,0.011224,0.1083,deprecated,True
|
| 100 |
+
exp_0099,planning,Cyclic dependency resolution in topological DAG ordering,Execute Tarjan strongly connected components algorithm before scheduling.,Never bypass cycle detection when parsing user-defined task graphs.,0.915,2,1,3,0.7143,0.02551,0.5546,active,False
|
| 101 |
+
exp_0100,coding,Cross-table entity reconciliation across heterogeneous schemas,Construct hybrid similarity metrics over normalized canonical keys.,Avoid raw string matching on unnormalized entity identifiers.,0.813,3,1,4,0.75,0.020833,0.6057,active,False
|
data/telemetry_traces.csv
ADDED
|
@@ -0,0 +1,1201 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
trial_id,ablation_condition,step_index,task_domain,cosine_similarity,observed_reward,task_success,cumulative_accuracy,in_poison_injection_regime,quarantine_triggered
|
| 2 |
+
1,vanilla_baseline,1,research,0.731,0.91,1,1.0,False,False
|
| 3 |
+
2,vanilla_baseline,2,analysis,0.86,0.35,0,0.5,False,False
|
| 4 |
+
3,vanilla_baseline,3,planning,0.834,0.95,1,0.6667,False,False
|
| 5 |
+
4,vanilla_baseline,4,coding,0.78,0.86,1,0.75,False,False
|
| 6 |
+
5,vanilla_baseline,5,research,0.726,0.32,0,0.6,False,False
|
| 7 |
+
6,vanilla_baseline,6,analysis,0.873,0.87,1,0.6667,False,False
|
| 8 |
+
7,vanilla_baseline,7,planning,0.754,0.92,1,0.7143,False,False
|
| 9 |
+
8,vanilla_baseline,8,coding,0.877,0.21,0,0.625,False,False
|
| 10 |
+
9,vanilla_baseline,9,research,0.93,0.26,0,0.5556,False,False
|
| 11 |
+
10,vanilla_baseline,10,analysis,0.855,0.88,1,0.6,False,False
|
| 12 |
+
11,vanilla_baseline,11,planning,0.798,0.15,0,0.5455,False,False
|
| 13 |
+
12,vanilla_baseline,12,coding,0.746,0.85,1,0.5833,False,False
|
| 14 |
+
13,vanilla_baseline,13,research,0.908,0.24,0,0.5385,False,False
|
| 15 |
+
14,vanilla_baseline,14,analysis,0.742,0.91,1,0.5714,False,False
|
| 16 |
+
15,vanilla_baseline,15,planning,0.758,0.9,1,0.6,False,False
|
| 17 |
+
16,vanilla_baseline,16,coding,0.855,0.86,1,0.625,False,False
|
| 18 |
+
17,vanilla_baseline,17,research,0.802,0.91,1,0.6471,False,False
|
| 19 |
+
18,vanilla_baseline,18,analysis,0.908,0.18,0,0.6111,False,False
|
| 20 |
+
19,vanilla_baseline,19,planning,0.736,0.85,1,0.6316,False,False
|
| 21 |
+
20,vanilla_baseline,20,coding,0.849,0.27,0,0.6,False,False
|
| 22 |
+
21,vanilla_baseline,21,research,0.805,0.9,1,0.619,False,False
|
| 23 |
+
22,vanilla_baseline,22,analysis,0.84,0.23,0,0.5909,False,False
|
| 24 |
+
23,vanilla_baseline,23,planning,0.931,0.19,0,0.5652,False,False
|
| 25 |
+
24,vanilla_baseline,24,coding,0.735,0.85,1,0.5833,False,False
|
| 26 |
+
25,vanilla_baseline,25,research,0.741,0.16,0,0.56,False,False
|
| 27 |
+
26,vanilla_baseline,26,analysis,0.79,0.15,0,0.5385,False,False
|
| 28 |
+
27,vanilla_baseline,27,planning,0.899,0.86,1,0.5556,False,False
|
| 29 |
+
28,vanilla_baseline,28,coding,0.873,0.96,1,0.5714,False,False
|
| 30 |
+
29,vanilla_baseline,29,research,0.882,0.21,0,0.5517,False,False
|
| 31 |
+
30,vanilla_baseline,30,analysis,0.759,0.31,0,0.5333,False,False
|
| 32 |
+
31,vanilla_baseline,31,planning,0.938,0.89,1,0.5484,False,False
|
| 33 |
+
32,vanilla_baseline,32,coding,0.891,0.96,1,0.5625,False,False
|
| 34 |
+
33,vanilla_baseline,33,research,0.909,0.94,1,0.5758,False,False
|
| 35 |
+
34,vanilla_baseline,34,analysis,0.886,0.96,1,0.5882,False,False
|
| 36 |
+
35,vanilla_baseline,35,planning,0.831,0.21,0,0.5714,False,False
|
| 37 |
+
36,vanilla_baseline,36,coding,0.917,0.85,1,0.5833,False,False
|
| 38 |
+
37,vanilla_baseline,37,research,0.919,0.89,1,0.5946,False,False
|
| 39 |
+
38,vanilla_baseline,38,analysis,0.929,0.26,0,0.5789,False,False
|
| 40 |
+
39,vanilla_baseline,39,planning,0.859,0.89,1,0.5897,False,False
|
| 41 |
+
40,vanilla_baseline,40,coding,0.792,0.3,0,0.575,False,False
|
| 42 |
+
41,vanilla_baseline,41,research,0.894,0.17,0,0.561,False,False
|
| 43 |
+
42,vanilla_baseline,42,analysis,0.829,0.92,1,0.5714,False,False
|
| 44 |
+
43,vanilla_baseline,43,planning,0.817,0.22,0,0.5581,False,False
|
| 45 |
+
44,vanilla_baseline,44,coding,0.746,0.94,1,0.5682,False,False
|
| 46 |
+
45,vanilla_baseline,45,research,0.856,0.86,1,0.5778,False,False
|
| 47 |
+
46,vanilla_baseline,46,analysis,0.874,0.95,1,0.587,False,False
|
| 48 |
+
47,vanilla_baseline,47,planning,0.875,0.86,1,0.5957,False,False
|
| 49 |
+
48,vanilla_baseline,48,coding,0.937,0.89,1,0.6042,False,False
|
| 50 |
+
49,vanilla_baseline,49,research,0.899,0.35,0,0.5918,False,False
|
| 51 |
+
50,vanilla_baseline,50,analysis,0.886,0.86,1,0.6,False,False
|
| 52 |
+
51,vanilla_baseline,51,planning,0.891,0.9,1,0.6078,False,False
|
| 53 |
+
52,vanilla_baseline,52,coding,0.919,0.91,1,0.6154,False,False
|
| 54 |
+
53,vanilla_baseline,53,research,0.722,0.86,1,0.6226,False,False
|
| 55 |
+
54,vanilla_baseline,54,analysis,0.746,0.93,1,0.6296,False,False
|
| 56 |
+
55,vanilla_baseline,55,planning,0.884,0.97,1,0.6364,False,False
|
| 57 |
+
56,vanilla_baseline,56,coding,0.802,0.95,1,0.6429,False,False
|
| 58 |
+
57,vanilla_baseline,57,research,0.769,0.15,0,0.6316,False,False
|
| 59 |
+
58,vanilla_baseline,58,analysis,0.933,0.96,1,0.6379,False,False
|
| 60 |
+
59,vanilla_baseline,59,planning,0.836,0.16,0,0.6271,False,False
|
| 61 |
+
60,vanilla_baseline,60,coding,0.842,0.25,0,0.6167,True,False
|
| 62 |
+
61,vanilla_baseline,61,research,0.858,0.24,0,0.6066,True,False
|
| 63 |
+
62,vanilla_baseline,62,analysis,0.858,0.96,1,0.6129,True,False
|
| 64 |
+
63,vanilla_baseline,63,planning,0.73,0.96,1,0.619,True,False
|
| 65 |
+
64,vanilla_baseline,64,coding,0.916,0.92,1,0.625,True,False
|
| 66 |
+
65,vanilla_baseline,65,research,0.781,0.91,1,0.6308,True,False
|
| 67 |
+
66,vanilla_baseline,66,analysis,0.798,0.86,1,0.6364,True,False
|
| 68 |
+
67,vanilla_baseline,67,planning,0.934,0.29,0,0.6269,True,False
|
| 69 |
+
68,vanilla_baseline,68,coding,0.838,0.95,1,0.6324,True,False
|
| 70 |
+
69,vanilla_baseline,69,research,0.871,0.96,1,0.6377,True,False
|
| 71 |
+
70,vanilla_baseline,70,analysis,0.901,0.3,0,0.6286,True,False
|
| 72 |
+
71,vanilla_baseline,71,planning,0.855,0.96,1,0.6338,True,False
|
| 73 |
+
72,vanilla_baseline,72,coding,0.911,0.85,1,0.6389,True,False
|
| 74 |
+
73,vanilla_baseline,73,research,0.803,0.35,0,0.6301,True,False
|
| 75 |
+
74,vanilla_baseline,74,analysis,0.753,0.9,1,0.6351,True,False
|
| 76 |
+
75,vanilla_baseline,75,planning,0.933,0.32,0,0.6267,True,False
|
| 77 |
+
76,vanilla_baseline,76,coding,0.823,0.88,1,0.6316,True,False
|
| 78 |
+
77,vanilla_baseline,77,research,0.732,0.31,0,0.6234,True,False
|
| 79 |
+
78,vanilla_baseline,78,analysis,0.94,0.26,0,0.6154,True,False
|
| 80 |
+
79,vanilla_baseline,79,planning,0.889,0.32,0,0.6076,True,False
|
| 81 |
+
80,vanilla_baseline,80,coding,0.774,0.87,1,0.6125,True,False
|
| 82 |
+
81,vanilla_baseline,81,research,0.93,0.88,1,0.6173,True,False
|
| 83 |
+
82,vanilla_baseline,82,analysis,0.868,0.89,1,0.622,True,False
|
| 84 |
+
83,vanilla_baseline,83,planning,0.745,0.25,0,0.6145,True,False
|
| 85 |
+
84,vanilla_baseline,84,coding,0.89,0.95,1,0.619,True,False
|
| 86 |
+
85,vanilla_baseline,85,research,0.841,0.96,1,0.6235,True,False
|
| 87 |
+
86,vanilla_baseline,86,analysis,0.809,0.85,1,0.6279,True,False
|
| 88 |
+
87,vanilla_baseline,87,planning,0.886,0.93,1,0.6322,True,False
|
| 89 |
+
88,vanilla_baseline,88,coding,0.767,0.85,1,0.6364,True,False
|
| 90 |
+
89,vanilla_baseline,89,research,0.797,0.9,1,0.6404,True,False
|
| 91 |
+
90,vanilla_baseline,90,analysis,0.816,0.22,0,0.6333,True,False
|
| 92 |
+
91,vanilla_baseline,91,planning,0.833,0.23,0,0.6264,True,False
|
| 93 |
+
92,vanilla_baseline,92,coding,0.857,0.34,0,0.6196,True,False
|
| 94 |
+
93,vanilla_baseline,93,research,0.752,0.25,0,0.6129,True,False
|
| 95 |
+
94,vanilla_baseline,94,analysis,0.777,0.97,1,0.617,True,False
|
| 96 |
+
95,vanilla_baseline,95,planning,0.828,0.93,1,0.6211,True,False
|
| 97 |
+
96,vanilla_baseline,96,coding,0.773,0.87,1,0.625,True,False
|
| 98 |
+
97,vanilla_baseline,97,research,0.748,0.87,1,0.6289,True,False
|
| 99 |
+
98,vanilla_baseline,98,analysis,0.861,0.89,1,0.6327,True,False
|
| 100 |
+
99,vanilla_baseline,99,planning,0.917,0.93,1,0.6364,True,False
|
| 101 |
+
100,vanilla_baseline,100,coding,0.758,0.85,1,0.64,True,False
|
| 102 |
+
101,vanilla_baseline,101,research,0.757,0.87,1,0.6436,True,False
|
| 103 |
+
102,vanilla_baseline,102,analysis,0.74,0.91,1,0.6471,True,False
|
| 104 |
+
103,vanilla_baseline,103,planning,0.765,0.91,1,0.6505,True,False
|
| 105 |
+
104,vanilla_baseline,104,coding,0.872,0.95,1,0.6538,True,False
|
| 106 |
+
105,vanilla_baseline,105,research,0.858,0.95,1,0.6571,True,False
|
| 107 |
+
106,vanilla_baseline,106,analysis,0.923,0.88,1,0.6604,True,False
|
| 108 |
+
107,vanilla_baseline,107,planning,0.897,0.19,0,0.6542,True,False
|
| 109 |
+
108,vanilla_baseline,108,coding,0.766,0.91,1,0.6574,True,False
|
| 110 |
+
109,vanilla_baseline,109,research,0.856,0.91,1,0.6606,True,False
|
| 111 |
+
110,vanilla_baseline,110,analysis,0.884,0.88,1,0.6636,True,False
|
| 112 |
+
111,vanilla_baseline,111,planning,0.877,0.25,0,0.6577,True,False
|
| 113 |
+
112,vanilla_baseline,112,coding,0.837,0.9,1,0.6607,True,False
|
| 114 |
+
113,vanilla_baseline,113,research,0.837,0.88,1,0.6637,True,False
|
| 115 |
+
114,vanilla_baseline,114,analysis,0.803,0.89,1,0.6667,True,False
|
| 116 |
+
115,vanilla_baseline,115,planning,0.767,0.86,1,0.6696,True,False
|
| 117 |
+
116,vanilla_baseline,116,coding,0.916,0.93,1,0.6724,True,False
|
| 118 |
+
117,vanilla_baseline,117,research,0.894,0.86,1,0.6752,True,False
|
| 119 |
+
118,vanilla_baseline,118,analysis,0.838,0.94,1,0.678,True,False
|
| 120 |
+
119,vanilla_baseline,119,planning,0.815,0.88,1,0.6807,True,False
|
| 121 |
+
120,vanilla_baseline,120,coding,0.8,0.92,1,0.6833,True,False
|
| 122 |
+
121,vanilla_baseline,121,research,0.798,0.27,0,0.6777,True,False
|
| 123 |
+
122,vanilla_baseline,122,analysis,0.772,0.87,1,0.6803,True,False
|
| 124 |
+
123,vanilla_baseline,123,planning,0.774,0.87,1,0.6829,True,False
|
| 125 |
+
124,vanilla_baseline,124,coding,0.783,0.96,1,0.6855,True,False
|
| 126 |
+
125,vanilla_baseline,125,research,0.738,0.9,1,0.688,True,False
|
| 127 |
+
126,vanilla_baseline,126,analysis,0.936,0.9,1,0.6905,True,False
|
| 128 |
+
127,vanilla_baseline,127,planning,0.933,0.31,0,0.685,True,False
|
| 129 |
+
128,vanilla_baseline,128,coding,0.777,0.93,1,0.6875,True,False
|
| 130 |
+
129,vanilla_baseline,129,research,0.924,0.92,1,0.6899,True,False
|
| 131 |
+
130,vanilla_baseline,130,analysis,0.782,0.19,0,0.6846,True,False
|
| 132 |
+
131,vanilla_baseline,131,planning,0.791,0.91,1,0.687,True,False
|
| 133 |
+
132,vanilla_baseline,132,coding,0.773,0.92,1,0.6894,True,False
|
| 134 |
+
133,vanilla_baseline,133,research,0.783,0.87,1,0.6917,True,False
|
| 135 |
+
134,vanilla_baseline,134,analysis,0.826,0.86,1,0.694,True,False
|
| 136 |
+
135,vanilla_baseline,135,planning,0.794,0.86,1,0.6963,True,False
|
| 137 |
+
136,vanilla_baseline,136,coding,0.938,0.95,1,0.6985,True,False
|
| 138 |
+
137,vanilla_baseline,137,research,0.776,0.3,0,0.6934,True,False
|
| 139 |
+
138,vanilla_baseline,138,analysis,0.851,0.9,1,0.6957,True,False
|
| 140 |
+
139,vanilla_baseline,139,planning,0.797,0.32,0,0.6906,True,False
|
| 141 |
+
140,vanilla_baseline,140,coding,0.932,0.94,1,0.6929,True,False
|
| 142 |
+
141,vanilla_baseline,141,research,0.926,0.86,1,0.695,False,False
|
| 143 |
+
142,vanilla_baseline,142,analysis,0.883,0.95,1,0.6972,False,False
|
| 144 |
+
143,vanilla_baseline,143,planning,0.751,0.19,0,0.6923,False,False
|
| 145 |
+
144,vanilla_baseline,144,coding,0.756,0.95,1,0.6944,False,False
|
| 146 |
+
145,vanilla_baseline,145,research,0.866,0.89,1,0.6966,False,False
|
| 147 |
+
146,vanilla_baseline,146,analysis,0.913,0.95,1,0.6986,False,False
|
| 148 |
+
147,vanilla_baseline,147,planning,0.817,0.91,1,0.7007,False,False
|
| 149 |
+
148,vanilla_baseline,148,coding,0.786,0.25,0,0.6959,False,False
|
| 150 |
+
149,vanilla_baseline,149,research,0.771,0.23,0,0.6913,False,False
|
| 151 |
+
150,vanilla_baseline,150,analysis,0.84,0.27,0,0.6867,False,False
|
| 152 |
+
151,vanilla_baseline,151,planning,0.746,0.28,0,0.6821,False,False
|
| 153 |
+
152,vanilla_baseline,152,coding,0.794,0.95,1,0.6842,False,False
|
| 154 |
+
153,vanilla_baseline,153,research,0.856,0.96,1,0.6863,False,False
|
| 155 |
+
154,vanilla_baseline,154,analysis,0.893,0.89,1,0.6883,False,False
|
| 156 |
+
155,vanilla_baseline,155,planning,0.775,0.16,0,0.6839,False,False
|
| 157 |
+
156,vanilla_baseline,156,coding,0.845,0.33,0,0.6795,False,False
|
| 158 |
+
157,vanilla_baseline,157,research,0.795,0.17,0,0.6752,False,False
|
| 159 |
+
158,vanilla_baseline,158,analysis,0.906,0.9,1,0.6772,False,False
|
| 160 |
+
159,vanilla_baseline,159,planning,0.895,0.88,1,0.6792,False,False
|
| 161 |
+
160,vanilla_baseline,160,coding,0.879,0.28,0,0.675,False,False
|
| 162 |
+
161,vanilla_baseline,161,research,0.873,0.88,1,0.677,False,False
|
| 163 |
+
162,vanilla_baseline,162,analysis,0.796,0.96,1,0.679,False,False
|
| 164 |
+
163,vanilla_baseline,163,planning,0.848,0.91,1,0.681,False,False
|
| 165 |
+
164,vanilla_baseline,164,coding,0.928,0.92,1,0.6829,False,False
|
| 166 |
+
165,vanilla_baseline,165,research,0.831,0.85,1,0.6848,False,False
|
| 167 |
+
166,vanilla_baseline,166,analysis,0.912,0.26,0,0.6807,False,False
|
| 168 |
+
167,vanilla_baseline,167,planning,0.873,0.29,0,0.6766,False,False
|
| 169 |
+
168,vanilla_baseline,168,coding,0.754,0.92,1,0.6786,False,False
|
| 170 |
+
169,vanilla_baseline,169,research,0.813,0.34,0,0.6746,False,False
|
| 171 |
+
170,vanilla_baseline,170,analysis,0.924,0.86,1,0.6765,False,False
|
| 172 |
+
171,vanilla_baseline,171,planning,0.937,0.17,0,0.6725,False,False
|
| 173 |
+
172,vanilla_baseline,172,coding,0.923,0.25,0,0.6686,False,False
|
| 174 |
+
173,vanilla_baseline,173,research,0.85,0.86,1,0.6705,False,False
|
| 175 |
+
174,vanilla_baseline,174,analysis,0.794,0.15,0,0.6667,False,False
|
| 176 |
+
175,vanilla_baseline,175,planning,0.793,0.91,1,0.6686,False,False
|
| 177 |
+
176,vanilla_baseline,176,coding,0.922,0.89,1,0.6705,False,False
|
| 178 |
+
177,vanilla_baseline,177,research,0.882,0.88,1,0.6723,False,False
|
| 179 |
+
178,vanilla_baseline,178,analysis,0.82,0.87,1,0.6742,False,False
|
| 180 |
+
179,vanilla_baseline,179,planning,0.83,0.96,1,0.676,False,False
|
| 181 |
+
180,vanilla_baseline,180,coding,0.8,0.93,1,0.6778,False,False
|
| 182 |
+
181,vanilla_baseline,181,research,0.723,0.19,0,0.674,False,False
|
| 183 |
+
182,vanilla_baseline,182,analysis,0.931,0.9,1,0.6758,False,False
|
| 184 |
+
183,vanilla_baseline,183,planning,0.739,0.25,0,0.6721,False,False
|
| 185 |
+
184,vanilla_baseline,184,coding,0.851,0.94,1,0.6739,False,False
|
| 186 |
+
185,vanilla_baseline,185,research,0.766,0.19,0,0.6703,False,False
|
| 187 |
+
186,vanilla_baseline,186,analysis,0.762,0.91,1,0.672,False,False
|
| 188 |
+
187,vanilla_baseline,187,planning,0.844,0.94,1,0.6738,False,False
|
| 189 |
+
188,vanilla_baseline,188,coding,0.82,0.9,1,0.6755,False,False
|
| 190 |
+
189,vanilla_baseline,189,research,0.808,0.87,1,0.6772,False,False
|
| 191 |
+
190,vanilla_baseline,190,analysis,0.76,0.34,0,0.6737,False,False
|
| 192 |
+
191,vanilla_baseline,191,planning,0.802,0.93,1,0.6754,False,False
|
| 193 |
+
192,vanilla_baseline,192,coding,0.81,0.87,1,0.6771,False,False
|
| 194 |
+
193,vanilla_baseline,193,research,0.878,0.16,0,0.6736,False,False
|
| 195 |
+
194,vanilla_baseline,194,analysis,0.769,0.93,1,0.6753,False,False
|
| 196 |
+
195,vanilla_baseline,195,planning,0.724,0.95,1,0.6769,False,False
|
| 197 |
+
196,vanilla_baseline,196,coding,0.759,0.2,0,0.6735,False,False
|
| 198 |
+
197,vanilla_baseline,197,research,0.742,0.94,1,0.6751,False,False
|
| 199 |
+
198,vanilla_baseline,198,analysis,0.908,0.23,0,0.6717,False,False
|
| 200 |
+
199,vanilla_baseline,199,planning,0.867,0.89,1,0.6734,False,False
|
| 201 |
+
200,vanilla_baseline,200,coding,0.917,0.86,1,0.675,False,False
|
| 202 |
+
201,vanilla_baseline,201,research,0.766,0.87,1,0.6766,False,False
|
| 203 |
+
202,vanilla_baseline,202,analysis,0.848,0.96,1,0.6782,False,False
|
| 204 |
+
203,vanilla_baseline,203,planning,0.9,0.88,1,0.6798,False,False
|
| 205 |
+
204,vanilla_baseline,204,coding,0.804,0.88,1,0.6814,False,False
|
| 206 |
+
205,vanilla_baseline,205,research,0.857,0.92,1,0.6829,False,False
|
| 207 |
+
206,vanilla_baseline,206,analysis,0.816,0.96,1,0.6845,False,False
|
| 208 |
+
207,vanilla_baseline,207,planning,0.888,0.95,1,0.686,False,False
|
| 209 |
+
208,vanilla_baseline,208,coding,0.827,0.31,0,0.6827,False,False
|
| 210 |
+
209,vanilla_baseline,209,research,0.814,0.88,1,0.6842,False,False
|
| 211 |
+
210,vanilla_baseline,210,analysis,0.839,0.88,1,0.6857,False,False
|
| 212 |
+
211,vanilla_baseline,211,planning,0.751,0.35,0,0.6825,False,False
|
| 213 |
+
212,vanilla_baseline,212,coding,0.836,0.88,1,0.684,False,False
|
| 214 |
+
213,vanilla_baseline,213,research,0.724,0.17,0,0.6808,False,False
|
| 215 |
+
214,vanilla_baseline,214,analysis,0.847,0.92,1,0.6822,False,False
|
| 216 |
+
215,vanilla_baseline,215,planning,0.863,0.19,0,0.6791,False,False
|
| 217 |
+
216,vanilla_baseline,216,coding,0.722,0.96,1,0.6806,False,False
|
| 218 |
+
217,vanilla_baseline,217,research,0.912,0.92,1,0.682,False,False
|
| 219 |
+
218,vanilla_baseline,218,analysis,0.866,0.96,1,0.6835,False,False
|
| 220 |
+
219,vanilla_baseline,219,planning,0.812,0.91,1,0.6849,False,False
|
| 221 |
+
220,vanilla_baseline,220,coding,0.73,0.94,1,0.6864,False,False
|
| 222 |
+
221,vanilla_baseline,221,research,0.738,0.88,1,0.6878,False,False
|
| 223 |
+
222,vanilla_baseline,222,analysis,0.806,0.89,1,0.6892,False,False
|
| 224 |
+
223,vanilla_baseline,223,planning,0.878,0.92,1,0.6906,False,False
|
| 225 |
+
224,vanilla_baseline,224,coding,0.825,0.34,0,0.6875,False,False
|
| 226 |
+
225,vanilla_baseline,225,research,0.881,0.85,1,0.6889,False,False
|
| 227 |
+
226,vanilla_baseline,226,analysis,0.778,0.86,1,0.6903,False,False
|
| 228 |
+
227,vanilla_baseline,227,planning,0.829,0.89,1,0.6916,False,False
|
| 229 |
+
228,vanilla_baseline,228,coding,0.89,0.86,1,0.693,False,False
|
| 230 |
+
229,vanilla_baseline,229,research,0.88,0.93,1,0.6943,False,False
|
| 231 |
+
230,vanilla_baseline,230,analysis,0.816,0.95,1,0.6957,False,False
|
| 232 |
+
231,vanilla_baseline,231,planning,0.896,0.2,0,0.6926,False,False
|
| 233 |
+
232,vanilla_baseline,232,coding,0.85,0.86,1,0.694,False,False
|
| 234 |
+
233,vanilla_baseline,233,research,0.922,0.96,1,0.6953,False,False
|
| 235 |
+
234,vanilla_baseline,234,analysis,0.818,0.92,1,0.6966,False,False
|
| 236 |
+
235,vanilla_baseline,235,planning,0.912,0.31,0,0.6936,False,False
|
| 237 |
+
236,vanilla_baseline,236,coding,0.865,0.32,0,0.6907,False,False
|
| 238 |
+
237,vanilla_baseline,237,research,0.775,0.88,1,0.692,False,False
|
| 239 |
+
238,vanilla_baseline,238,analysis,0.937,0.16,0,0.6891,False,False
|
| 240 |
+
239,vanilla_baseline,239,planning,0.875,0.19,0,0.6862,False,False
|
| 241 |
+
240,vanilla_baseline,240,coding,0.845,0.16,0,0.6833,False,False
|
| 242 |
+
241,vanilla_baseline,241,research,0.873,0.96,1,0.6846,False,False
|
| 243 |
+
242,vanilla_baseline,242,analysis,0.934,0.24,0,0.6818,False,False
|
| 244 |
+
243,vanilla_baseline,243,planning,0.91,0.21,0,0.679,False,False
|
| 245 |
+
244,vanilla_baseline,244,coding,0.902,0.92,1,0.6803,False,False
|
| 246 |
+
245,vanilla_baseline,245,research,0.771,0.86,1,0.6816,False,False
|
| 247 |
+
246,vanilla_baseline,246,analysis,0.873,0.94,1,0.6829,False,False
|
| 248 |
+
247,vanilla_baseline,247,planning,0.734,0.91,1,0.6842,False,False
|
| 249 |
+
248,vanilla_baseline,248,coding,0.894,0.93,1,0.6855,False,False
|
| 250 |
+
249,vanilla_baseline,249,research,0.915,0.88,1,0.6867,False,False
|
| 251 |
+
250,vanilla_baseline,250,analysis,0.725,0.15,0,0.684,False,False
|
| 252 |
+
251,vanilla_baseline,251,planning,0.912,0.96,1,0.6853,False,False
|
| 253 |
+
252,vanilla_baseline,252,coding,0.896,0.22,0,0.6825,False,False
|
| 254 |
+
253,vanilla_baseline,253,research,0.889,0.91,1,0.6838,False,False
|
| 255 |
+
254,vanilla_baseline,254,analysis,0.858,0.35,0,0.6811,False,False
|
| 256 |
+
255,vanilla_baseline,255,planning,0.889,0.9,1,0.6824,False,False
|
| 257 |
+
256,vanilla_baseline,256,coding,0.882,0.86,1,0.6836,False,False
|
| 258 |
+
257,vanilla_baseline,257,research,0.798,0.89,1,0.6848,False,False
|
| 259 |
+
258,vanilla_baseline,258,analysis,0.771,0.85,1,0.686,False,False
|
| 260 |
+
259,vanilla_baseline,259,planning,0.937,0.9,1,0.6873,False,False
|
| 261 |
+
260,vanilla_baseline,260,coding,0.87,0.96,1,0.6885,False,False
|
| 262 |
+
261,vanilla_baseline,261,research,0.893,0.9,1,0.6897,False,False
|
| 263 |
+
262,vanilla_baseline,262,analysis,0.913,0.24,0,0.687,False,False
|
| 264 |
+
263,vanilla_baseline,263,planning,0.855,0.97,1,0.6882,False,False
|
| 265 |
+
264,vanilla_baseline,264,coding,0.771,0.28,0,0.6856,False,False
|
| 266 |
+
265,vanilla_baseline,265,research,0.854,0.88,1,0.6868,False,False
|
| 267 |
+
266,vanilla_baseline,266,analysis,0.759,0.87,1,0.688,False,False
|
| 268 |
+
267,vanilla_baseline,267,planning,0.892,0.86,1,0.6891,False,False
|
| 269 |
+
268,vanilla_baseline,268,coding,0.933,0.34,0,0.6866,False,False
|
| 270 |
+
269,vanilla_baseline,269,research,0.939,0.9,1,0.6877,False,False
|
| 271 |
+
270,vanilla_baseline,270,analysis,0.887,0.18,0,0.6852,False,False
|
| 272 |
+
271,vanilla_baseline,271,planning,0.899,0.88,1,0.6863,False,False
|
| 273 |
+
272,vanilla_baseline,272,coding,0.838,0.92,1,0.6875,False,False
|
| 274 |
+
273,vanilla_baseline,273,research,0.74,0.2,0,0.685,False,False
|
| 275 |
+
274,vanilla_baseline,274,analysis,0.748,0.34,0,0.6825,False,False
|
| 276 |
+
275,vanilla_baseline,275,planning,0.91,0.28,0,0.68,False,False
|
| 277 |
+
276,vanilla_baseline,276,coding,0.841,0.9,1,0.6812,False,False
|
| 278 |
+
277,vanilla_baseline,277,research,0.802,0.94,1,0.6823,False,False
|
| 279 |
+
278,vanilla_baseline,278,analysis,0.829,0.88,1,0.6835,False,False
|
| 280 |
+
279,vanilla_baseline,279,planning,0.87,0.95,1,0.6846,False,False
|
| 281 |
+
280,vanilla_baseline,280,coding,0.829,0.92,1,0.6857,False,False
|
| 282 |
+
281,vanilla_baseline,281,research,0.901,0.93,1,0.6868,False,False
|
| 283 |
+
282,vanilla_baseline,282,analysis,0.844,0.96,1,0.6879,False,False
|
| 284 |
+
283,vanilla_baseline,283,planning,0.895,0.32,0,0.6855,False,False
|
| 285 |
+
284,vanilla_baseline,284,coding,0.911,0.32,0,0.6831,False,False
|
| 286 |
+
285,vanilla_baseline,285,research,0.873,0.27,0,0.6807,False,False
|
| 287 |
+
286,vanilla_baseline,286,analysis,0.886,0.96,1,0.6818,False,False
|
| 288 |
+
287,vanilla_baseline,287,planning,0.912,0.95,1,0.6829,False,False
|
| 289 |
+
288,vanilla_baseline,288,coding,0.748,0.94,1,0.684,False,False
|
| 290 |
+
289,vanilla_baseline,289,research,0.755,0.32,0,0.6817,False,False
|
| 291 |
+
290,vanilla_baseline,290,analysis,0.832,0.88,1,0.6828,False,False
|
| 292 |
+
291,vanilla_baseline,291,planning,0.856,0.28,0,0.6804,False,False
|
| 293 |
+
292,vanilla_baseline,292,coding,0.777,0.91,1,0.6815,False,False
|
| 294 |
+
293,vanilla_baseline,293,research,0.892,0.94,1,0.6826,False,False
|
| 295 |
+
294,vanilla_baseline,294,analysis,0.839,0.22,0,0.6803,False,False
|
| 296 |
+
295,vanilla_baseline,295,planning,0.859,0.17,0,0.678,False,False
|
| 297 |
+
296,vanilla_baseline,296,coding,0.926,0.16,0,0.6757,False,False
|
| 298 |
+
297,vanilla_baseline,297,research,0.786,0.16,0,0.6734,False,False
|
| 299 |
+
298,vanilla_baseline,298,analysis,0.848,0.92,1,0.6745,False,False
|
| 300 |
+
299,vanilla_baseline,299,planning,0.73,0.34,0,0.6722,False,False
|
| 301 |
+
300,vanilla_baseline,300,coding,0.933,0.18,0,0.67,False,False
|
| 302 |
+
301,naive_vector_rag,1,research,0.887,0.85,1,1.0,False,False
|
| 303 |
+
302,naive_vector_rag,2,analysis,0.791,0.94,1,1.0,False,False
|
| 304 |
+
303,naive_vector_rag,3,planning,0.87,0.88,1,1.0,False,False
|
| 305 |
+
304,naive_vector_rag,4,coding,0.939,0.9,1,1.0,False,False
|
| 306 |
+
305,naive_vector_rag,5,research,0.756,0.93,1,1.0,False,False
|
| 307 |
+
306,naive_vector_rag,6,analysis,0.769,0.93,1,1.0,False,False
|
| 308 |
+
307,naive_vector_rag,7,planning,0.864,0.96,1,1.0,False,False
|
| 309 |
+
308,naive_vector_rag,8,coding,0.753,0.96,1,1.0,False,False
|
| 310 |
+
309,naive_vector_rag,9,research,0.812,0.9,1,1.0,False,False
|
| 311 |
+
310,naive_vector_rag,10,analysis,0.78,0.23,0,0.9,False,False
|
| 312 |
+
311,naive_vector_rag,11,planning,0.917,0.88,1,0.9091,False,False
|
| 313 |
+
312,naive_vector_rag,12,coding,0.727,0.89,1,0.9167,False,False
|
| 314 |
+
313,naive_vector_rag,13,research,0.91,0.97,1,0.9231,False,False
|
| 315 |
+
314,naive_vector_rag,14,analysis,0.761,0.31,0,0.8571,False,False
|
| 316 |
+
315,naive_vector_rag,15,planning,0.89,0.94,1,0.8667,False,False
|
| 317 |
+
316,naive_vector_rag,16,coding,0.858,0.85,1,0.875,False,False
|
| 318 |
+
317,naive_vector_rag,17,research,0.923,0.95,1,0.8824,False,False
|
| 319 |
+
318,naive_vector_rag,18,analysis,0.826,0.87,1,0.8889,False,False
|
| 320 |
+
319,naive_vector_rag,19,planning,0.871,0.87,1,0.8947,False,False
|
| 321 |
+
320,naive_vector_rag,20,coding,0.828,0.92,1,0.9,False,False
|
| 322 |
+
321,naive_vector_rag,21,research,0.779,0.89,1,0.9048,False,False
|
| 323 |
+
322,naive_vector_rag,22,analysis,0.82,0.86,1,0.9091,False,False
|
| 324 |
+
323,naive_vector_rag,23,planning,0.806,0.92,1,0.913,False,False
|
| 325 |
+
324,naive_vector_rag,24,coding,0.784,0.95,1,0.9167,False,False
|
| 326 |
+
325,naive_vector_rag,25,research,0.892,0.91,1,0.92,False,False
|
| 327 |
+
326,naive_vector_rag,26,analysis,0.743,0.97,1,0.9231,False,False
|
| 328 |
+
327,naive_vector_rag,27,planning,0.751,0.92,1,0.9259,False,False
|
| 329 |
+
328,naive_vector_rag,28,coding,0.875,0.85,1,0.9286,False,False
|
| 330 |
+
329,naive_vector_rag,29,research,0.792,0.86,1,0.931,False,False
|
| 331 |
+
330,naive_vector_rag,30,analysis,0.797,0.86,1,0.9333,False,False
|
| 332 |
+
331,naive_vector_rag,31,planning,0.807,0.92,1,0.9355,False,False
|
| 333 |
+
332,naive_vector_rag,32,coding,0.872,0.87,1,0.9375,False,False
|
| 334 |
+
333,naive_vector_rag,33,research,0.757,0.93,1,0.9394,False,False
|
| 335 |
+
334,naive_vector_rag,34,analysis,0.875,0.96,1,0.9412,False,False
|
| 336 |
+
335,naive_vector_rag,35,planning,0.731,0.94,1,0.9429,False,False
|
| 337 |
+
336,naive_vector_rag,36,coding,0.912,0.95,1,0.9444,False,False
|
| 338 |
+
337,naive_vector_rag,37,research,0.795,0.86,1,0.9459,False,False
|
| 339 |
+
338,naive_vector_rag,38,analysis,0.917,0.95,1,0.9474,False,False
|
| 340 |
+
339,naive_vector_rag,39,planning,0.82,0.91,1,0.9487,False,False
|
| 341 |
+
340,naive_vector_rag,40,coding,0.881,0.86,1,0.95,False,False
|
| 342 |
+
341,naive_vector_rag,41,research,0.774,0.95,1,0.9512,False,False
|
| 343 |
+
342,naive_vector_rag,42,analysis,0.768,0.22,0,0.9286,False,False
|
| 344 |
+
343,naive_vector_rag,43,planning,0.76,0.93,1,0.9302,False,False
|
| 345 |
+
344,naive_vector_rag,44,coding,0.83,0.94,1,0.9318,False,False
|
| 346 |
+
345,naive_vector_rag,45,research,0.77,0.34,0,0.9111,False,False
|
| 347 |
+
346,naive_vector_rag,46,analysis,0.863,0.93,1,0.913,False,False
|
| 348 |
+
347,naive_vector_rag,47,planning,0.736,0.88,1,0.9149,False,False
|
| 349 |
+
348,naive_vector_rag,48,coding,0.822,0.3,0,0.8958,False,False
|
| 350 |
+
349,naive_vector_rag,49,research,0.883,0.89,1,0.898,False,False
|
| 351 |
+
350,naive_vector_rag,50,analysis,0.802,0.16,0,0.88,False,False
|
| 352 |
+
351,naive_vector_rag,51,planning,0.911,0.9,1,0.8824,False,False
|
| 353 |
+
352,naive_vector_rag,52,coding,0.88,0.95,1,0.8846,False,False
|
| 354 |
+
353,naive_vector_rag,53,research,0.918,0.88,1,0.8868,False,False
|
| 355 |
+
354,naive_vector_rag,54,analysis,0.85,0.19,0,0.8704,False,False
|
| 356 |
+
355,naive_vector_rag,55,planning,0.857,0.94,1,0.8727,False,False
|
| 357 |
+
356,naive_vector_rag,56,coding,0.749,0.96,1,0.875,False,False
|
| 358 |
+
357,naive_vector_rag,57,research,0.76,0.97,1,0.8772,False,False
|
| 359 |
+
358,naive_vector_rag,58,analysis,0.76,0.25,0,0.8621,False,False
|
| 360 |
+
359,naive_vector_rag,59,planning,0.774,0.24,0,0.8475,False,False
|
| 361 |
+
360,naive_vector_rag,60,coding,0.833,0.27,0,0.8333,True,False
|
| 362 |
+
361,naive_vector_rag,61,research,0.756,0.34,0,0.8197,True,False
|
| 363 |
+
362,naive_vector_rag,62,analysis,0.777,0.22,0,0.8065,True,False
|
| 364 |
+
363,naive_vector_rag,63,planning,0.89,0.97,1,0.8095,True,False
|
| 365 |
+
364,naive_vector_rag,64,coding,0.82,0.16,0,0.7969,True,False
|
| 366 |
+
365,naive_vector_rag,65,research,0.757,0.22,0,0.7846,True,False
|
| 367 |
+
366,naive_vector_rag,66,analysis,0.902,0.2,0,0.7727,True,False
|
| 368 |
+
367,naive_vector_rag,67,planning,0.856,0.18,0,0.7612,True,False
|
| 369 |
+
368,naive_vector_rag,68,coding,0.757,0.94,1,0.7647,True,False
|
| 370 |
+
369,naive_vector_rag,69,research,0.866,0.32,0,0.7536,True,False
|
| 371 |
+
370,naive_vector_rag,70,analysis,0.897,0.32,0,0.7429,True,False
|
| 372 |
+
371,naive_vector_rag,71,planning,0.765,0.88,1,0.7465,True,False
|
| 373 |
+
372,naive_vector_rag,72,coding,0.733,0.34,0,0.7361,True,False
|
| 374 |
+
373,naive_vector_rag,73,research,0.729,0.9,1,0.7397,True,False
|
| 375 |
+
374,naive_vector_rag,74,analysis,0.925,0.25,0,0.7297,True,False
|
| 376 |
+
375,naive_vector_rag,75,planning,0.729,0.97,1,0.7333,True,False
|
| 377 |
+
376,naive_vector_rag,76,coding,0.932,0.96,1,0.7368,True,False
|
| 378 |
+
377,naive_vector_rag,77,research,0.861,0.24,0,0.7273,True,False
|
| 379 |
+
378,naive_vector_rag,78,analysis,0.833,0.28,0,0.7179,True,False
|
| 380 |
+
379,naive_vector_rag,79,planning,0.751,0.89,1,0.7215,True,False
|
| 381 |
+
380,naive_vector_rag,80,coding,0.875,0.93,1,0.725,True,False
|
| 382 |
+
381,naive_vector_rag,81,research,0.933,0.93,1,0.7284,True,False
|
| 383 |
+
382,naive_vector_rag,82,analysis,0.818,0.19,0,0.7195,True,False
|
| 384 |
+
383,naive_vector_rag,83,planning,0.872,0.34,0,0.7108,True,False
|
| 385 |
+
384,naive_vector_rag,84,coding,0.87,0.27,0,0.7024,True,False
|
| 386 |
+
385,naive_vector_rag,85,research,0.911,0.16,0,0.6941,True,False
|
| 387 |
+
386,naive_vector_rag,86,analysis,0.925,0.29,0,0.686,True,False
|
| 388 |
+
387,naive_vector_rag,87,planning,0.767,0.23,0,0.6782,True,False
|
| 389 |
+
388,naive_vector_rag,88,coding,0.863,0.93,1,0.6818,True,False
|
| 390 |
+
389,naive_vector_rag,89,research,0.94,0.97,1,0.6854,True,False
|
| 391 |
+
390,naive_vector_rag,90,analysis,0.81,0.31,0,0.6778,True,False
|
| 392 |
+
391,naive_vector_rag,91,planning,0.845,0.33,0,0.6703,True,False
|
| 393 |
+
392,naive_vector_rag,92,coding,0.809,0.28,0,0.663,True,False
|
| 394 |
+
393,naive_vector_rag,93,research,0.898,0.31,0,0.6559,True,False
|
| 395 |
+
394,naive_vector_rag,94,analysis,0.816,0.17,0,0.6489,True,False
|
| 396 |
+
395,naive_vector_rag,95,planning,0.84,0.89,1,0.6526,True,False
|
| 397 |
+
396,naive_vector_rag,96,coding,0.801,0.29,0,0.6458,True,False
|
| 398 |
+
397,naive_vector_rag,97,research,0.805,0.2,0,0.6392,True,False
|
| 399 |
+
398,naive_vector_rag,98,analysis,0.802,0.16,0,0.6327,True,False
|
| 400 |
+
399,naive_vector_rag,99,planning,0.853,0.27,0,0.6263,True,False
|
| 401 |
+
400,naive_vector_rag,100,coding,0.822,0.32,0,0.62,True,False
|
| 402 |
+
401,naive_vector_rag,101,research,0.834,0.16,0,0.6139,True,False
|
| 403 |
+
402,naive_vector_rag,102,analysis,0.795,0.23,0,0.6078,True,False
|
| 404 |
+
403,naive_vector_rag,103,planning,0.848,0.27,0,0.6019,True,False
|
| 405 |
+
404,naive_vector_rag,104,coding,0.888,0.29,0,0.5962,True,False
|
| 406 |
+
405,naive_vector_rag,105,research,0.93,0.87,1,0.6,True,False
|
| 407 |
+
406,naive_vector_rag,106,analysis,0.722,0.33,0,0.5943,True,False
|
| 408 |
+
407,naive_vector_rag,107,planning,0.774,0.16,0,0.5888,True,False
|
| 409 |
+
408,naive_vector_rag,108,coding,0.926,0.17,0,0.5833,True,False
|
| 410 |
+
409,naive_vector_rag,109,research,0.827,0.21,0,0.578,True,False
|
| 411 |
+
410,naive_vector_rag,110,analysis,0.788,0.26,0,0.5727,True,False
|
| 412 |
+
411,naive_vector_rag,111,planning,0.788,0.29,0,0.5676,True,False
|
| 413 |
+
412,naive_vector_rag,112,coding,0.78,0.17,0,0.5625,True,False
|
| 414 |
+
413,naive_vector_rag,113,research,0.76,0.19,0,0.5575,True,False
|
| 415 |
+
414,naive_vector_rag,114,analysis,0.836,0.17,0,0.5526,True,False
|
| 416 |
+
415,naive_vector_rag,115,planning,0.845,0.34,0,0.5478,True,False
|
| 417 |
+
416,naive_vector_rag,116,coding,0.826,0.26,0,0.5431,True,False
|
| 418 |
+
417,naive_vector_rag,117,research,0.73,0.34,0,0.5385,True,False
|
| 419 |
+
418,naive_vector_rag,118,analysis,0.852,0.33,0,0.5339,True,False
|
| 420 |
+
419,naive_vector_rag,119,planning,0.77,0.92,1,0.5378,True,False
|
| 421 |
+
420,naive_vector_rag,120,coding,0.81,0.33,0,0.5333,True,False
|
| 422 |
+
421,naive_vector_rag,121,research,0.798,0.31,0,0.5289,True,False
|
| 423 |
+
422,naive_vector_rag,122,analysis,0.78,0.23,0,0.5246,True,False
|
| 424 |
+
423,naive_vector_rag,123,planning,0.867,0.92,1,0.5285,True,False
|
| 425 |
+
424,naive_vector_rag,124,coding,0.819,0.18,0,0.5242,True,False
|
| 426 |
+
425,naive_vector_rag,125,research,0.882,0.19,0,0.52,True,False
|
| 427 |
+
426,naive_vector_rag,126,analysis,0.741,0.93,1,0.5238,True,False
|
| 428 |
+
427,naive_vector_rag,127,planning,0.854,0.2,0,0.5197,True,False
|
| 429 |
+
428,naive_vector_rag,128,coding,0.806,0.25,0,0.5156,True,False
|
| 430 |
+
429,naive_vector_rag,129,research,0.937,0.93,1,0.5194,True,False
|
| 431 |
+
430,naive_vector_rag,130,analysis,0.809,0.29,0,0.5154,True,False
|
| 432 |
+
431,naive_vector_rag,131,planning,0.872,0.18,0,0.5115,True,False
|
| 433 |
+
432,naive_vector_rag,132,coding,0.743,0.27,0,0.5076,True,False
|
| 434 |
+
433,naive_vector_rag,133,research,0.78,0.86,1,0.5113,True,False
|
| 435 |
+
434,naive_vector_rag,134,analysis,0.917,0.89,1,0.5149,True,False
|
| 436 |
+
435,naive_vector_rag,135,planning,0.77,0.16,0,0.5111,True,False
|
| 437 |
+
436,naive_vector_rag,136,coding,0.834,0.95,1,0.5147,True,False
|
| 438 |
+
437,naive_vector_rag,137,research,0.771,0.33,0,0.5109,True,False
|
| 439 |
+
438,naive_vector_rag,138,analysis,0.863,0.21,0,0.5072,True,False
|
| 440 |
+
439,naive_vector_rag,139,planning,0.793,0.35,0,0.5036,True,False
|
| 441 |
+
440,naive_vector_rag,140,coding,0.866,0.3,0,0.5,True,False
|
| 442 |
+
441,naive_vector_rag,141,research,0.822,0.92,1,0.5035,False,False
|
| 443 |
+
442,naive_vector_rag,142,analysis,0.931,0.93,1,0.507,False,False
|
| 444 |
+
443,naive_vector_rag,143,planning,0.764,0.86,1,0.5105,False,False
|
| 445 |
+
444,naive_vector_rag,144,coding,0.819,0.89,1,0.5139,False,False
|
| 446 |
+
445,naive_vector_rag,145,research,0.866,0.96,1,0.5172,False,False
|
| 447 |
+
446,naive_vector_rag,146,analysis,0.772,0.87,1,0.5205,False,False
|
| 448 |
+
447,naive_vector_rag,147,planning,0.938,0.26,0,0.517,False,False
|
| 449 |
+
448,naive_vector_rag,148,coding,0.905,0.92,1,0.5203,False,False
|
| 450 |
+
449,naive_vector_rag,149,research,0.74,0.87,1,0.5235,False,False
|
| 451 |
+
450,naive_vector_rag,150,analysis,0.902,0.94,1,0.5267,False,False
|
| 452 |
+
451,naive_vector_rag,151,planning,0.728,0.88,1,0.5298,False,False
|
| 453 |
+
452,naive_vector_rag,152,coding,0.799,0.96,1,0.5329,False,False
|
| 454 |
+
453,naive_vector_rag,153,research,0.842,0.9,1,0.5359,False,False
|
| 455 |
+
454,naive_vector_rag,154,analysis,0.818,0.91,1,0.539,False,False
|
| 456 |
+
455,naive_vector_rag,155,planning,0.922,0.97,1,0.5419,False,False
|
| 457 |
+
456,naive_vector_rag,156,coding,0.907,0.96,1,0.5449,False,False
|
| 458 |
+
457,naive_vector_rag,157,research,0.746,0.9,1,0.5478,False,False
|
| 459 |
+
458,naive_vector_rag,158,analysis,0.913,0.31,0,0.5443,False,False
|
| 460 |
+
459,naive_vector_rag,159,planning,0.894,0.86,1,0.5472,False,False
|
| 461 |
+
460,naive_vector_rag,160,coding,0.809,0.93,1,0.55,False,False
|
| 462 |
+
461,naive_vector_rag,161,research,0.796,0.28,0,0.5466,False,False
|
| 463 |
+
462,naive_vector_rag,162,analysis,0.901,0.95,1,0.5494,False,False
|
| 464 |
+
463,naive_vector_rag,163,planning,0.923,0.92,1,0.5521,False,False
|
| 465 |
+
464,naive_vector_rag,164,coding,0.888,0.91,1,0.5549,False,False
|
| 466 |
+
465,naive_vector_rag,165,research,0.808,0.89,1,0.5576,False,False
|
| 467 |
+
466,naive_vector_rag,166,analysis,0.735,0.87,1,0.5602,False,False
|
| 468 |
+
467,naive_vector_rag,167,planning,0.932,0.97,1,0.5629,False,False
|
| 469 |
+
468,naive_vector_rag,168,coding,0.815,0.91,1,0.5655,False,False
|
| 470 |
+
469,naive_vector_rag,169,research,0.817,0.93,1,0.568,False,False
|
| 471 |
+
470,naive_vector_rag,170,analysis,0.768,0.93,1,0.5706,False,False
|
| 472 |
+
471,naive_vector_rag,171,planning,0.753,0.94,1,0.5731,False,False
|
| 473 |
+
472,naive_vector_rag,172,coding,0.821,0.97,1,0.5756,False,False
|
| 474 |
+
473,naive_vector_rag,173,research,0.733,0.97,1,0.578,False,False
|
| 475 |
+
474,naive_vector_rag,174,analysis,0.773,0.86,1,0.5805,False,False
|
| 476 |
+
475,naive_vector_rag,175,planning,0.787,0.93,1,0.5829,False,False
|
| 477 |
+
476,naive_vector_rag,176,coding,0.734,0.97,1,0.5852,False,False
|
| 478 |
+
477,naive_vector_rag,177,research,0.899,0.89,1,0.5876,False,False
|
| 479 |
+
478,naive_vector_rag,178,analysis,0.857,0.9,1,0.5899,False,False
|
| 480 |
+
479,naive_vector_rag,179,planning,0.749,0.24,0,0.5866,False,False
|
| 481 |
+
480,naive_vector_rag,180,coding,0.763,0.9,1,0.5889,False,False
|
| 482 |
+
481,naive_vector_rag,181,research,0.902,0.94,1,0.5912,False,False
|
| 483 |
+
482,naive_vector_rag,182,analysis,0.722,0.91,1,0.5934,False,False
|
| 484 |
+
483,naive_vector_rag,183,planning,0.724,0.94,1,0.5956,False,False
|
| 485 |
+
484,naive_vector_rag,184,coding,0.75,0.88,1,0.5978,False,False
|
| 486 |
+
485,naive_vector_rag,185,research,0.723,0.97,1,0.6,False,False
|
| 487 |
+
486,naive_vector_rag,186,analysis,0.896,0.25,0,0.5968,False,False
|
| 488 |
+
487,naive_vector_rag,187,planning,0.744,0.9,1,0.5989,False,False
|
| 489 |
+
488,naive_vector_rag,188,coding,0.906,0.91,1,0.6011,False,False
|
| 490 |
+
489,naive_vector_rag,189,research,0.753,0.94,1,0.6032,False,False
|
| 491 |
+
490,naive_vector_rag,190,analysis,0.825,0.9,1,0.6053,False,False
|
| 492 |
+
491,naive_vector_rag,191,planning,0.821,0.96,1,0.6073,False,False
|
| 493 |
+
492,naive_vector_rag,192,coding,0.93,0.89,1,0.6094,False,False
|
| 494 |
+
493,naive_vector_rag,193,research,0.871,0.88,1,0.6114,False,False
|
| 495 |
+
494,naive_vector_rag,194,analysis,0.905,0.96,1,0.6134,False,False
|
| 496 |
+
495,naive_vector_rag,195,planning,0.822,0.93,1,0.6154,False,False
|
| 497 |
+
496,naive_vector_rag,196,coding,0.917,0.92,1,0.6173,False,False
|
| 498 |
+
497,naive_vector_rag,197,research,0.735,0.87,1,0.6193,False,False
|
| 499 |
+
498,naive_vector_rag,198,analysis,0.882,0.93,1,0.6212,False,False
|
| 500 |
+
499,naive_vector_rag,199,planning,0.729,0.94,1,0.6231,False,False
|
| 501 |
+
500,naive_vector_rag,200,coding,0.736,0.85,1,0.625,False,False
|
| 502 |
+
501,naive_vector_rag,201,research,0.93,0.89,1,0.6269,False,False
|
| 503 |
+
502,naive_vector_rag,202,analysis,0.785,0.94,1,0.6287,False,False
|
| 504 |
+
503,naive_vector_rag,203,planning,0.866,0.87,1,0.6305,False,False
|
| 505 |
+
504,naive_vector_rag,204,coding,0.742,0.94,1,0.6324,False,False
|
| 506 |
+
505,naive_vector_rag,205,research,0.778,0.86,1,0.6341,False,False
|
| 507 |
+
506,naive_vector_rag,206,analysis,0.933,0.94,1,0.6359,False,False
|
| 508 |
+
507,naive_vector_rag,207,planning,0.857,0.87,1,0.6377,False,False
|
| 509 |
+
508,naive_vector_rag,208,coding,0.747,0.94,1,0.6394,False,False
|
| 510 |
+
509,naive_vector_rag,209,research,0.862,0.86,1,0.6411,False,False
|
| 511 |
+
510,naive_vector_rag,210,analysis,0.933,0.89,1,0.6429,False,False
|
| 512 |
+
511,naive_vector_rag,211,planning,0.936,0.92,1,0.6445,False,False
|
| 513 |
+
512,naive_vector_rag,212,coding,0.885,0.93,1,0.6462,False,False
|
| 514 |
+
513,naive_vector_rag,213,research,0.748,0.96,1,0.6479,False,False
|
| 515 |
+
514,naive_vector_rag,214,analysis,0.769,0.9,1,0.6495,False,False
|
| 516 |
+
515,naive_vector_rag,215,planning,0.817,0.96,1,0.6512,False,False
|
| 517 |
+
516,naive_vector_rag,216,coding,0.773,0.87,1,0.6528,False,False
|
| 518 |
+
517,naive_vector_rag,217,research,0.915,0.88,1,0.6544,False,False
|
| 519 |
+
518,naive_vector_rag,218,analysis,0.9,0.32,0,0.6514,False,False
|
| 520 |
+
519,naive_vector_rag,219,planning,0.922,0.94,1,0.653,False,False
|
| 521 |
+
520,naive_vector_rag,220,coding,0.821,0.94,1,0.6545,False,False
|
| 522 |
+
521,naive_vector_rag,221,research,0.891,0.87,1,0.6561,False,False
|
| 523 |
+
522,naive_vector_rag,222,analysis,0.84,0.34,0,0.6532,False,False
|
| 524 |
+
523,naive_vector_rag,223,planning,0.729,0.87,1,0.6547,False,False
|
| 525 |
+
524,naive_vector_rag,224,coding,0.88,0.88,1,0.6562,False,False
|
| 526 |
+
525,naive_vector_rag,225,research,0.831,0.94,1,0.6578,False,False
|
| 527 |
+
526,naive_vector_rag,226,analysis,0.839,0.91,1,0.6593,False,False
|
| 528 |
+
527,naive_vector_rag,227,planning,0.785,0.93,1,0.6608,False,False
|
| 529 |
+
528,naive_vector_rag,228,coding,0.912,0.94,1,0.6623,False,False
|
| 530 |
+
529,naive_vector_rag,229,research,0.755,0.85,1,0.6638,False,False
|
| 531 |
+
530,naive_vector_rag,230,analysis,0.774,0.97,1,0.6652,False,False
|
| 532 |
+
531,naive_vector_rag,231,planning,0.742,0.95,1,0.6667,False,False
|
| 533 |
+
532,naive_vector_rag,232,coding,0.765,0.94,1,0.6681,False,False
|
| 534 |
+
533,naive_vector_rag,233,research,0.856,0.89,1,0.6695,False,False
|
| 535 |
+
534,naive_vector_rag,234,analysis,0.892,0.85,1,0.6709,False,False
|
| 536 |
+
535,naive_vector_rag,235,planning,0.887,0.94,1,0.6723,False,False
|
| 537 |
+
536,naive_vector_rag,236,coding,0.765,0.22,0,0.6695,False,False
|
| 538 |
+
537,naive_vector_rag,237,research,0.792,0.89,1,0.6709,False,False
|
| 539 |
+
538,naive_vector_rag,238,analysis,0.913,0.22,0,0.6681,False,False
|
| 540 |
+
539,naive_vector_rag,239,planning,0.819,0.96,1,0.6695,False,False
|
| 541 |
+
540,naive_vector_rag,240,coding,0.85,0.9,1,0.6708,False,False
|
| 542 |
+
541,naive_vector_rag,241,research,0.873,0.92,1,0.6722,False,False
|
| 543 |
+
542,naive_vector_rag,242,analysis,0.798,0.86,1,0.6736,False,False
|
| 544 |
+
543,naive_vector_rag,243,planning,0.849,0.93,1,0.6749,False,False
|
| 545 |
+
544,naive_vector_rag,244,coding,0.734,0.92,1,0.6762,False,False
|
| 546 |
+
545,naive_vector_rag,245,research,0.843,0.93,1,0.6776,False,False
|
| 547 |
+
546,naive_vector_rag,246,analysis,0.897,0.95,1,0.6789,False,False
|
| 548 |
+
547,naive_vector_rag,247,planning,0.83,0.86,1,0.6802,False,False
|
| 549 |
+
548,naive_vector_rag,248,coding,0.794,0.93,1,0.6815,False,False
|
| 550 |
+
549,naive_vector_rag,249,research,0.893,0.9,1,0.6827,False,False
|
| 551 |
+
550,naive_vector_rag,250,analysis,0.752,0.9,1,0.684,False,False
|
| 552 |
+
551,naive_vector_rag,251,planning,0.739,0.92,1,0.6853,False,False
|
| 553 |
+
552,naive_vector_rag,252,coding,0.882,0.34,0,0.6825,False,False
|
| 554 |
+
553,naive_vector_rag,253,research,0.861,0.93,1,0.6838,False,False
|
| 555 |
+
554,naive_vector_rag,254,analysis,0.893,0.9,1,0.685,False,False
|
| 556 |
+
555,naive_vector_rag,255,planning,0.905,0.92,1,0.6863,False,False
|
| 557 |
+
556,naive_vector_rag,256,coding,0.849,0.89,1,0.6875,False,False
|
| 558 |
+
557,naive_vector_rag,257,research,0.794,0.85,1,0.6887,False,False
|
| 559 |
+
558,naive_vector_rag,258,analysis,0.903,0.91,1,0.6899,False,False
|
| 560 |
+
559,naive_vector_rag,259,planning,0.786,0.2,0,0.6873,False,False
|
| 561 |
+
560,naive_vector_rag,260,coding,0.815,0.32,0,0.6846,False,False
|
| 562 |
+
561,naive_vector_rag,261,research,0.761,0.9,1,0.6858,False,False
|
| 563 |
+
562,naive_vector_rag,262,analysis,0.826,0.86,1,0.687,False,False
|
| 564 |
+
563,naive_vector_rag,263,planning,0.88,0.9,1,0.6882,False,False
|
| 565 |
+
564,naive_vector_rag,264,coding,0.88,0.87,1,0.6894,False,False
|
| 566 |
+
565,naive_vector_rag,265,research,0.854,0.94,1,0.6906,False,False
|
| 567 |
+
566,naive_vector_rag,266,analysis,0.865,0.16,0,0.688,False,False
|
| 568 |
+
567,naive_vector_rag,267,planning,0.733,0.88,1,0.6891,False,False
|
| 569 |
+
568,naive_vector_rag,268,coding,0.774,0.2,0,0.6866,False,False
|
| 570 |
+
569,naive_vector_rag,269,research,0.78,0.9,1,0.6877,False,False
|
| 571 |
+
570,naive_vector_rag,270,analysis,0.891,0.91,1,0.6889,False,False
|
| 572 |
+
571,naive_vector_rag,271,planning,0.727,0.96,1,0.69,False,False
|
| 573 |
+
572,naive_vector_rag,272,coding,0.751,0.9,1,0.6912,False,False
|
| 574 |
+
573,naive_vector_rag,273,research,0.796,0.15,0,0.6886,False,False
|
| 575 |
+
574,naive_vector_rag,274,analysis,0.866,0.26,0,0.6861,False,False
|
| 576 |
+
575,naive_vector_rag,275,planning,0.926,0.9,1,0.6873,False,False
|
| 577 |
+
576,naive_vector_rag,276,coding,0.777,0.97,1,0.6884,False,False
|
| 578 |
+
577,naive_vector_rag,277,research,0.776,0.87,1,0.6895,False,False
|
| 579 |
+
578,naive_vector_rag,278,analysis,0.844,0.97,1,0.6906,False,False
|
| 580 |
+
579,naive_vector_rag,279,planning,0.854,0.86,1,0.6918,False,False
|
| 581 |
+
580,naive_vector_rag,280,coding,0.753,0.88,1,0.6929,False,False
|
| 582 |
+
581,naive_vector_rag,281,research,0.907,0.91,1,0.694,False,False
|
| 583 |
+
582,naive_vector_rag,282,analysis,0.745,0.29,0,0.6915,False,False
|
| 584 |
+
583,naive_vector_rag,283,planning,0.735,0.92,1,0.6926,False,False
|
| 585 |
+
584,naive_vector_rag,284,coding,0.738,0.91,1,0.6937,False,False
|
| 586 |
+
585,naive_vector_rag,285,research,0.756,0.32,0,0.6912,False,False
|
| 587 |
+
586,naive_vector_rag,286,analysis,0.867,0.9,1,0.6923,False,False
|
| 588 |
+
587,naive_vector_rag,287,planning,0.863,0.86,1,0.6934,False,False
|
| 589 |
+
588,naive_vector_rag,288,coding,0.833,0.91,1,0.6944,False,False
|
| 590 |
+
589,naive_vector_rag,289,research,0.731,0.87,1,0.6955,False,False
|
| 591 |
+
590,naive_vector_rag,290,analysis,0.777,0.89,1,0.6966,False,False
|
| 592 |
+
591,naive_vector_rag,291,planning,0.886,0.87,1,0.6976,False,False
|
| 593 |
+
592,naive_vector_rag,292,coding,0.913,0.32,0,0.6952,False,False
|
| 594 |
+
593,naive_vector_rag,293,research,0.773,0.97,1,0.6962,False,False
|
| 595 |
+
594,naive_vector_rag,294,analysis,0.89,0.86,1,0.6973,False,False
|
| 596 |
+
595,naive_vector_rag,295,planning,0.822,0.26,0,0.6949,False,False
|
| 597 |
+
596,naive_vector_rag,296,coding,0.83,0.93,1,0.6959,False,False
|
| 598 |
+
597,naive_vector_rag,297,research,0.901,0.94,1,0.697,False,False
|
| 599 |
+
598,naive_vector_rag,298,analysis,0.932,0.91,1,0.698,False,False
|
| 600 |
+
599,naive_vector_rag,299,planning,0.783,0.92,1,0.699,False,False
|
| 601 |
+
600,naive_vector_rag,300,coding,0.86,0.9,1,0.7,False,False
|
| 602 |
+
601,symmetric_reflexion,1,research,0.921,0.87,1,1.0,False,False
|
| 603 |
+
602,symmetric_reflexion,2,analysis,0.873,0.89,1,1.0,False,False
|
| 604 |
+
603,symmetric_reflexion,3,planning,0.909,0.21,0,0.6667,False,False
|
| 605 |
+
604,symmetric_reflexion,4,coding,0.936,0.87,1,0.75,False,False
|
| 606 |
+
605,symmetric_reflexion,5,research,0.761,0.28,0,0.6,False,False
|
| 607 |
+
606,symmetric_reflexion,6,analysis,0.753,0.92,1,0.6667,False,False
|
| 608 |
+
607,symmetric_reflexion,7,planning,0.738,0.31,0,0.5714,False,False
|
| 609 |
+
608,symmetric_reflexion,8,coding,0.831,0.23,0,0.5,False,False
|
| 610 |
+
609,symmetric_reflexion,9,research,0.937,0.93,1,0.5556,False,False
|
| 611 |
+
610,symmetric_reflexion,10,analysis,0.757,0.24,0,0.5,False,False
|
| 612 |
+
611,symmetric_reflexion,11,planning,0.756,0.92,1,0.5455,False,False
|
| 613 |
+
612,symmetric_reflexion,12,coding,0.836,0.96,1,0.5833,False,False
|
| 614 |
+
613,symmetric_reflexion,13,research,0.737,0.87,1,0.6154,False,False
|
| 615 |
+
614,symmetric_reflexion,14,analysis,0.909,0.91,1,0.6429,False,False
|
| 616 |
+
615,symmetric_reflexion,15,planning,0.876,0.91,1,0.6667,False,False
|
| 617 |
+
616,symmetric_reflexion,16,coding,0.901,0.89,1,0.6875,False,False
|
| 618 |
+
617,symmetric_reflexion,17,research,0.829,0.89,1,0.7059,False,False
|
| 619 |
+
618,symmetric_reflexion,18,analysis,0.758,0.95,1,0.7222,False,False
|
| 620 |
+
619,symmetric_reflexion,19,planning,0.742,0.87,1,0.7368,False,False
|
| 621 |
+
620,symmetric_reflexion,20,coding,0.797,0.94,1,0.75,False,False
|
| 622 |
+
621,symmetric_reflexion,21,research,0.863,0.89,1,0.7619,False,False
|
| 623 |
+
622,symmetric_reflexion,22,analysis,0.905,0.97,1,0.7727,False,False
|
| 624 |
+
623,symmetric_reflexion,23,planning,0.86,0.93,1,0.7826,False,False
|
| 625 |
+
624,symmetric_reflexion,24,coding,0.792,0.86,1,0.7917,False,False
|
| 626 |
+
625,symmetric_reflexion,25,research,0.758,0.2,0,0.76,False,False
|
| 627 |
+
626,symmetric_reflexion,26,analysis,0.904,0.93,1,0.7692,False,False
|
| 628 |
+
627,symmetric_reflexion,27,planning,0.873,0.89,1,0.7778,False,False
|
| 629 |
+
628,symmetric_reflexion,28,coding,0.767,0.89,1,0.7857,False,False
|
| 630 |
+
629,symmetric_reflexion,29,research,0.864,0.32,0,0.7586,False,False
|
| 631 |
+
630,symmetric_reflexion,30,analysis,0.889,0.93,1,0.7667,False,False
|
| 632 |
+
631,symmetric_reflexion,31,planning,0.777,0.28,0,0.7419,False,False
|
| 633 |
+
632,symmetric_reflexion,32,coding,0.843,0.9,1,0.75,False,False
|
| 634 |
+
633,symmetric_reflexion,33,research,0.821,0.26,0,0.7273,False,False
|
| 635 |
+
634,symmetric_reflexion,34,analysis,0.804,0.17,0,0.7059,False,False
|
| 636 |
+
635,symmetric_reflexion,35,planning,0.813,0.94,1,0.7143,False,False
|
| 637 |
+
636,symmetric_reflexion,36,coding,0.922,0.95,1,0.7222,False,False
|
| 638 |
+
637,symmetric_reflexion,37,research,0.784,0.3,0,0.7027,False,False
|
| 639 |
+
638,symmetric_reflexion,38,analysis,0.897,0.97,1,0.7105,False,False
|
| 640 |
+
639,symmetric_reflexion,39,planning,0.88,0.95,1,0.7179,False,False
|
| 641 |
+
640,symmetric_reflexion,40,coding,0.782,0.17,0,0.7,False,False
|
| 642 |
+
641,symmetric_reflexion,41,research,0.875,0.86,1,0.7073,False,False
|
| 643 |
+
642,symmetric_reflexion,42,analysis,0.773,0.91,1,0.7143,False,False
|
| 644 |
+
643,symmetric_reflexion,43,planning,0.786,0.89,1,0.7209,False,False
|
| 645 |
+
644,symmetric_reflexion,44,coding,0.786,0.86,1,0.7273,False,False
|
| 646 |
+
645,symmetric_reflexion,45,research,0.919,0.28,0,0.7111,False,False
|
| 647 |
+
646,symmetric_reflexion,46,analysis,0.851,0.19,0,0.6957,False,False
|
| 648 |
+
647,symmetric_reflexion,47,planning,0.737,0.95,1,0.7021,False,False
|
| 649 |
+
648,symmetric_reflexion,48,coding,0.728,0.97,1,0.7083,False,False
|
| 650 |
+
649,symmetric_reflexion,49,research,0.908,0.86,1,0.7143,False,False
|
| 651 |
+
650,symmetric_reflexion,50,analysis,0.903,0.86,1,0.72,False,False
|
| 652 |
+
651,symmetric_reflexion,51,planning,0.741,0.28,0,0.7059,False,False
|
| 653 |
+
652,symmetric_reflexion,52,coding,0.902,0.26,0,0.6923,False,False
|
| 654 |
+
653,symmetric_reflexion,53,research,0.834,0.89,1,0.6981,False,False
|
| 655 |
+
654,symmetric_reflexion,54,analysis,0.816,0.92,1,0.7037,False,False
|
| 656 |
+
655,symmetric_reflexion,55,planning,0.916,0.92,1,0.7091,False,False
|
| 657 |
+
656,symmetric_reflexion,56,coding,0.859,0.93,1,0.7143,False,False
|
| 658 |
+
657,symmetric_reflexion,57,research,0.772,0.86,1,0.7193,False,False
|
| 659 |
+
658,symmetric_reflexion,58,analysis,0.805,0.93,1,0.7241,False,False
|
| 660 |
+
659,symmetric_reflexion,59,planning,0.929,0.94,1,0.7288,False,False
|
| 661 |
+
660,symmetric_reflexion,60,coding,0.831,0.16,0,0.7167,True,False
|
| 662 |
+
661,symmetric_reflexion,61,research,0.776,0.24,0,0.7049,True,False
|
| 663 |
+
662,symmetric_reflexion,62,analysis,0.73,0.88,1,0.7097,True,False
|
| 664 |
+
663,symmetric_reflexion,63,planning,0.934,0.25,0,0.6984,True,False
|
| 665 |
+
664,symmetric_reflexion,64,coding,0.763,0.21,0,0.6875,True,False
|
| 666 |
+
665,symmetric_reflexion,65,research,0.766,0.15,0,0.6769,True,False
|
| 667 |
+
666,symmetric_reflexion,66,analysis,0.722,0.85,1,0.6818,True,False
|
| 668 |
+
667,symmetric_reflexion,67,planning,0.744,0.31,0,0.6716,True,False
|
| 669 |
+
668,symmetric_reflexion,68,coding,0.846,0.21,0,0.6618,True,False
|
| 670 |
+
669,symmetric_reflexion,69,research,0.925,0.17,0,0.6522,True,False
|
| 671 |
+
670,symmetric_reflexion,70,analysis,0.856,0.89,1,0.6571,True,False
|
| 672 |
+
671,symmetric_reflexion,71,planning,0.832,0.25,0,0.6479,True,False
|
| 673 |
+
672,symmetric_reflexion,72,coding,0.874,0.18,0,0.6389,True,False
|
| 674 |
+
673,symmetric_reflexion,73,research,0.78,0.23,0,0.6301,True,False
|
| 675 |
+
674,symmetric_reflexion,74,analysis,0.81,0.29,0,0.6216,True,True
|
| 676 |
+
675,symmetric_reflexion,75,planning,0.854,0.95,1,0.6267,True,False
|
| 677 |
+
676,symmetric_reflexion,76,coding,0.93,0.15,0,0.6184,True,False
|
| 678 |
+
677,symmetric_reflexion,77,research,0.86,0.88,1,0.6234,True,False
|
| 679 |
+
678,symmetric_reflexion,78,analysis,0.733,0.29,0,0.6154,True,False
|
| 680 |
+
679,symmetric_reflexion,79,planning,0.745,0.24,0,0.6076,True,False
|
| 681 |
+
680,symmetric_reflexion,80,coding,0.801,0.9,1,0.6125,True,False
|
| 682 |
+
681,symmetric_reflexion,81,research,0.885,0.86,1,0.6173,True,False
|
| 683 |
+
682,symmetric_reflexion,82,analysis,0.798,0.28,0,0.6098,True,False
|
| 684 |
+
683,symmetric_reflexion,83,planning,0.869,0.27,0,0.6024,True,False
|
| 685 |
+
684,symmetric_reflexion,84,coding,0.722,0.33,0,0.5952,True,False
|
| 686 |
+
685,symmetric_reflexion,85,research,0.855,0.29,0,0.5882,True,False
|
| 687 |
+
686,symmetric_reflexion,86,analysis,0.747,0.16,0,0.5814,True,False
|
| 688 |
+
687,symmetric_reflexion,87,planning,0.837,0.85,1,0.5862,True,False
|
| 689 |
+
688,symmetric_reflexion,88,coding,0.813,0.91,1,0.5909,True,False
|
| 690 |
+
689,symmetric_reflexion,89,research,0.847,0.86,1,0.5955,True,False
|
| 691 |
+
690,symmetric_reflexion,90,analysis,0.843,0.3,0,0.5889,True,False
|
| 692 |
+
691,symmetric_reflexion,91,planning,0.864,0.29,0,0.5824,True,False
|
| 693 |
+
692,symmetric_reflexion,92,coding,0.815,0.21,0,0.5761,True,False
|
| 694 |
+
693,symmetric_reflexion,93,research,0.787,0.24,0,0.5699,True,False
|
| 695 |
+
694,symmetric_reflexion,94,analysis,0.896,0.32,0,0.5638,True,False
|
| 696 |
+
695,symmetric_reflexion,95,planning,0.922,0.21,0,0.5579,True,True
|
| 697 |
+
696,symmetric_reflexion,96,coding,0.848,0.92,1,0.5625,True,False
|
| 698 |
+
697,symmetric_reflexion,97,research,0.875,0.22,0,0.5567,True,False
|
| 699 |
+
698,symmetric_reflexion,98,analysis,0.757,0.18,0,0.551,True,False
|
| 700 |
+
699,symmetric_reflexion,99,planning,0.916,0.18,0,0.5455,True,True
|
| 701 |
+
700,symmetric_reflexion,100,coding,0.726,0.93,1,0.55,True,False
|
| 702 |
+
701,symmetric_reflexion,101,research,0.795,0.9,1,0.5545,True,False
|
| 703 |
+
702,symmetric_reflexion,102,analysis,0.788,0.27,0,0.549,True,False
|
| 704 |
+
703,symmetric_reflexion,103,planning,0.8,0.97,1,0.5534,True,False
|
| 705 |
+
704,symmetric_reflexion,104,coding,0.82,0.18,0,0.5481,True,False
|
| 706 |
+
705,symmetric_reflexion,105,research,0.827,0.91,1,0.5524,True,False
|
| 707 |
+
706,symmetric_reflexion,106,analysis,0.932,0.16,0,0.5472,True,False
|
| 708 |
+
707,symmetric_reflexion,107,planning,0.727,0.18,0,0.5421,True,False
|
| 709 |
+
708,symmetric_reflexion,108,coding,0.725,0.24,0,0.537,True,False
|
| 710 |
+
709,symmetric_reflexion,109,research,0.784,0.17,0,0.5321,True,False
|
| 711 |
+
710,symmetric_reflexion,110,analysis,0.93,0.33,0,0.5273,True,True
|
| 712 |
+
711,symmetric_reflexion,111,planning,0.853,0.97,1,0.5315,True,False
|
| 713 |
+
712,symmetric_reflexion,112,coding,0.783,0.23,0,0.5268,True,False
|
| 714 |
+
713,symmetric_reflexion,113,research,0.805,0.26,0,0.5221,True,False
|
| 715 |
+
714,symmetric_reflexion,114,analysis,0.754,0.26,0,0.5175,True,False
|
| 716 |
+
715,symmetric_reflexion,115,planning,0.888,0.24,0,0.513,True,True
|
| 717 |
+
716,symmetric_reflexion,116,coding,0.787,0.87,1,0.5172,True,False
|
| 718 |
+
717,symmetric_reflexion,117,research,0.733,0.2,0,0.5128,True,False
|
| 719 |
+
718,symmetric_reflexion,118,analysis,0.933,0.22,0,0.5085,True,False
|
| 720 |
+
719,symmetric_reflexion,119,planning,0.848,0.9,1,0.5126,True,False
|
| 721 |
+
720,symmetric_reflexion,120,coding,0.858,0.23,0,0.5083,True,False
|
| 722 |
+
721,symmetric_reflexion,121,research,0.939,0.27,0,0.5041,True,False
|
| 723 |
+
722,symmetric_reflexion,122,analysis,0.845,0.19,0,0.5,True,False
|
| 724 |
+
723,symmetric_reflexion,123,planning,0.807,0.91,1,0.5041,True,False
|
| 725 |
+
724,symmetric_reflexion,124,coding,0.839,0.97,1,0.5081,True,False
|
| 726 |
+
725,symmetric_reflexion,125,research,0.92,0.26,0,0.504,True,False
|
| 727 |
+
726,symmetric_reflexion,126,analysis,0.911,0.94,1,0.5079,True,False
|
| 728 |
+
727,symmetric_reflexion,127,planning,0.747,0.21,0,0.5039,True,False
|
| 729 |
+
728,symmetric_reflexion,128,coding,0.913,0.18,0,0.5,True,False
|
| 730 |
+
729,symmetric_reflexion,129,research,0.822,0.25,0,0.4961,True,False
|
| 731 |
+
730,symmetric_reflexion,130,analysis,0.91,0.23,0,0.4923,True,False
|
| 732 |
+
731,symmetric_reflexion,131,planning,0.783,0.94,1,0.4962,True,False
|
| 733 |
+
732,symmetric_reflexion,132,coding,0.805,0.25,0,0.4924,True,False
|
| 734 |
+
733,symmetric_reflexion,133,research,0.847,0.35,0,0.4887,True,False
|
| 735 |
+
734,symmetric_reflexion,134,analysis,0.81,0.3,0,0.4851,True,False
|
| 736 |
+
735,symmetric_reflexion,135,planning,0.846,0.19,0,0.4815,True,False
|
| 737 |
+
736,symmetric_reflexion,136,coding,0.744,0.24,0,0.4779,True,True
|
| 738 |
+
737,symmetric_reflexion,137,research,0.906,0.16,0,0.4745,True,True
|
| 739 |
+
738,symmetric_reflexion,138,analysis,0.914,0.91,1,0.4783,True,False
|
| 740 |
+
739,symmetric_reflexion,139,planning,0.858,0.15,0,0.4748,True,False
|
| 741 |
+
740,symmetric_reflexion,140,coding,0.825,0.29,0,0.4714,True,False
|
| 742 |
+
741,symmetric_reflexion,141,research,0.872,0.89,1,0.4752,False,False
|
| 743 |
+
742,symmetric_reflexion,142,analysis,0.799,0.88,1,0.4789,False,False
|
| 744 |
+
743,symmetric_reflexion,143,planning,0.766,0.15,0,0.4755,False,False
|
| 745 |
+
744,symmetric_reflexion,144,coding,0.94,0.95,1,0.4792,False,False
|
| 746 |
+
745,symmetric_reflexion,145,research,0.785,0.94,1,0.4828,False,False
|
| 747 |
+
746,symmetric_reflexion,146,analysis,0.904,0.87,1,0.4863,False,False
|
| 748 |
+
747,symmetric_reflexion,147,planning,0.886,0.93,1,0.4898,False,False
|
| 749 |
+
748,symmetric_reflexion,148,coding,0.889,0.27,0,0.4865,False,False
|
| 750 |
+
749,symmetric_reflexion,149,research,0.739,0.86,1,0.4899,False,False
|
| 751 |
+
750,symmetric_reflexion,150,analysis,0.81,0.86,1,0.4933,False,False
|
| 752 |
+
751,symmetric_reflexion,151,planning,0.797,0.95,1,0.4967,False,False
|
| 753 |
+
752,symmetric_reflexion,152,coding,0.928,0.96,1,0.5,False,False
|
| 754 |
+
753,symmetric_reflexion,153,research,0.835,0.86,1,0.5033,False,False
|
| 755 |
+
754,symmetric_reflexion,154,analysis,0.83,0.93,1,0.5065,False,False
|
| 756 |
+
755,symmetric_reflexion,155,planning,0.731,0.9,1,0.5097,False,False
|
| 757 |
+
756,symmetric_reflexion,156,coding,0.785,0.88,1,0.5128,False,False
|
| 758 |
+
757,symmetric_reflexion,157,research,0.897,0.23,0,0.5096,False,False
|
| 759 |
+
758,symmetric_reflexion,158,analysis,0.919,0.91,1,0.5127,False,False
|
| 760 |
+
759,symmetric_reflexion,159,planning,0.77,0.97,1,0.5157,False,False
|
| 761 |
+
760,symmetric_reflexion,160,coding,0.853,0.93,1,0.5188,False,False
|
| 762 |
+
761,symmetric_reflexion,161,research,0.747,0.25,0,0.5155,False,False
|
| 763 |
+
762,symmetric_reflexion,162,analysis,0.819,0.92,1,0.5185,False,False
|
| 764 |
+
763,symmetric_reflexion,163,planning,0.736,0.88,1,0.5215,False,False
|
| 765 |
+
764,symmetric_reflexion,164,coding,0.877,0.95,1,0.5244,False,False
|
| 766 |
+
765,symmetric_reflexion,165,research,0.842,0.87,1,0.5273,False,False
|
| 767 |
+
766,symmetric_reflexion,166,analysis,0.891,0.91,1,0.5301,False,False
|
| 768 |
+
767,symmetric_reflexion,167,planning,0.783,0.93,1,0.5329,False,False
|
| 769 |
+
768,symmetric_reflexion,168,coding,0.732,0.89,1,0.5357,False,False
|
| 770 |
+
769,symmetric_reflexion,169,research,0.72,0.86,1,0.5385,False,False
|
| 771 |
+
770,symmetric_reflexion,170,analysis,0.781,0.86,1,0.5412,False,False
|
| 772 |
+
771,symmetric_reflexion,171,planning,0.905,0.88,1,0.5439,False,False
|
| 773 |
+
772,symmetric_reflexion,172,coding,0.883,0.86,1,0.5465,False,False
|
| 774 |
+
773,symmetric_reflexion,173,research,0.799,0.95,1,0.5491,False,False
|
| 775 |
+
774,symmetric_reflexion,174,analysis,0.789,0.96,1,0.5517,False,False
|
| 776 |
+
775,symmetric_reflexion,175,planning,0.815,0.23,0,0.5486,False,False
|
| 777 |
+
776,symmetric_reflexion,176,coding,0.932,0.93,1,0.5511,False,False
|
| 778 |
+
777,symmetric_reflexion,177,research,0.829,0.93,1,0.5537,False,False
|
| 779 |
+
778,symmetric_reflexion,178,analysis,0.875,0.87,1,0.5562,False,False
|
| 780 |
+
779,symmetric_reflexion,179,planning,0.877,0.97,1,0.5587,False,False
|
| 781 |
+
780,symmetric_reflexion,180,coding,0.887,0.29,0,0.5556,False,False
|
| 782 |
+
781,symmetric_reflexion,181,research,0.786,0.94,1,0.558,False,False
|
| 783 |
+
782,symmetric_reflexion,182,analysis,0.862,0.89,1,0.5604,False,False
|
| 784 |
+
783,symmetric_reflexion,183,planning,0.93,0.9,1,0.5628,False,False
|
| 785 |
+
784,symmetric_reflexion,184,coding,0.821,0.89,1,0.5652,False,False
|
| 786 |
+
785,symmetric_reflexion,185,research,0.801,0.94,1,0.5676,False,False
|
| 787 |
+
786,symmetric_reflexion,186,analysis,0.812,0.95,1,0.5699,False,False
|
| 788 |
+
787,symmetric_reflexion,187,planning,0.767,0.91,1,0.5722,False,False
|
| 789 |
+
788,symmetric_reflexion,188,coding,0.914,0.93,1,0.5745,False,False
|
| 790 |
+
789,symmetric_reflexion,189,research,0.854,0.87,1,0.5767,False,False
|
| 791 |
+
790,symmetric_reflexion,190,analysis,0.863,0.89,1,0.5789,False,False
|
| 792 |
+
791,symmetric_reflexion,191,planning,0.862,0.94,1,0.5812,False,False
|
| 793 |
+
792,symmetric_reflexion,192,coding,0.764,0.21,0,0.5781,False,False
|
| 794 |
+
793,symmetric_reflexion,193,research,0.801,0.86,1,0.5803,False,False
|
| 795 |
+
794,symmetric_reflexion,194,analysis,0.833,0.95,1,0.5825,False,False
|
| 796 |
+
795,symmetric_reflexion,195,planning,0.723,0.89,1,0.5846,False,False
|
| 797 |
+
796,symmetric_reflexion,196,coding,0.724,0.9,1,0.5867,False,False
|
| 798 |
+
797,symmetric_reflexion,197,research,0.828,0.91,1,0.5888,False,False
|
| 799 |
+
798,symmetric_reflexion,198,analysis,0.851,0.91,1,0.5909,False,False
|
| 800 |
+
799,symmetric_reflexion,199,planning,0.932,0.93,1,0.593,False,False
|
| 801 |
+
800,symmetric_reflexion,200,coding,0.789,0.94,1,0.595,False,False
|
| 802 |
+
801,symmetric_reflexion,201,research,0.835,0.18,0,0.592,False,False
|
| 803 |
+
802,symmetric_reflexion,202,analysis,0.724,0.95,1,0.5941,False,False
|
| 804 |
+
803,symmetric_reflexion,203,planning,0.746,0.85,1,0.5961,False,False
|
| 805 |
+
804,symmetric_reflexion,204,coding,0.785,0.91,1,0.598,False,False
|
| 806 |
+
805,symmetric_reflexion,205,research,0.797,0.85,1,0.6,False,False
|
| 807 |
+
806,symmetric_reflexion,206,analysis,0.786,0.97,1,0.6019,False,False
|
| 808 |
+
807,symmetric_reflexion,207,planning,0.906,0.96,1,0.6039,False,False
|
| 809 |
+
808,symmetric_reflexion,208,coding,0.892,0.9,1,0.6058,False,False
|
| 810 |
+
809,symmetric_reflexion,209,research,0.808,0.86,1,0.6077,False,False
|
| 811 |
+
810,symmetric_reflexion,210,analysis,0.77,0.91,1,0.6095,False,False
|
| 812 |
+
811,symmetric_reflexion,211,planning,0.884,0.86,1,0.6114,False,False
|
| 813 |
+
812,symmetric_reflexion,212,coding,0.931,0.31,0,0.6085,False,False
|
| 814 |
+
813,symmetric_reflexion,213,research,0.938,0.97,1,0.6103,False,False
|
| 815 |
+
814,symmetric_reflexion,214,analysis,0.737,0.88,1,0.6121,False,False
|
| 816 |
+
815,symmetric_reflexion,215,planning,0.763,0.92,1,0.614,False,False
|
| 817 |
+
816,symmetric_reflexion,216,coding,0.892,0.87,1,0.6157,False,False
|
| 818 |
+
817,symmetric_reflexion,217,research,0.898,0.9,1,0.6175,False,False
|
| 819 |
+
818,symmetric_reflexion,218,analysis,0.868,0.89,1,0.6193,False,False
|
| 820 |
+
819,symmetric_reflexion,219,planning,0.922,0.91,1,0.621,False,False
|
| 821 |
+
820,symmetric_reflexion,220,coding,0.916,0.86,1,0.6227,False,False
|
| 822 |
+
821,symmetric_reflexion,221,research,0.752,0.93,1,0.6244,False,False
|
| 823 |
+
822,symmetric_reflexion,222,analysis,0.818,0.96,1,0.6261,False,False
|
| 824 |
+
823,symmetric_reflexion,223,planning,0.837,0.91,1,0.6278,False,False
|
| 825 |
+
824,symmetric_reflexion,224,coding,0.87,0.88,1,0.6295,False,False
|
| 826 |
+
825,symmetric_reflexion,225,research,0.898,0.92,1,0.6311,False,False
|
| 827 |
+
826,symmetric_reflexion,226,analysis,0.815,0.87,1,0.6327,False,False
|
| 828 |
+
827,symmetric_reflexion,227,planning,0.818,0.86,1,0.6344,False,False
|
| 829 |
+
828,symmetric_reflexion,228,coding,0.906,0.31,0,0.6316,False,False
|
| 830 |
+
829,symmetric_reflexion,229,research,0.908,0.97,1,0.6332,False,False
|
| 831 |
+
830,symmetric_reflexion,230,analysis,0.763,0.35,0,0.6304,False,False
|
| 832 |
+
831,symmetric_reflexion,231,planning,0.877,0.26,0,0.6277,False,False
|
| 833 |
+
832,symmetric_reflexion,232,coding,0.777,0.92,1,0.6293,False,False
|
| 834 |
+
833,symmetric_reflexion,233,research,0.736,0.97,1,0.6309,False,False
|
| 835 |
+
834,symmetric_reflexion,234,analysis,0.762,0.96,1,0.6325,False,False
|
| 836 |
+
835,symmetric_reflexion,235,planning,0.928,0.25,0,0.6298,False,False
|
| 837 |
+
836,symmetric_reflexion,236,coding,0.935,0.87,1,0.6314,False,False
|
| 838 |
+
837,symmetric_reflexion,237,research,0.825,0.88,1,0.6329,False,False
|
| 839 |
+
838,symmetric_reflexion,238,analysis,0.861,0.87,1,0.6345,False,False
|
| 840 |
+
839,symmetric_reflexion,239,planning,0.844,0.91,1,0.636,False,False
|
| 841 |
+
840,symmetric_reflexion,240,coding,0.723,0.89,1,0.6375,False,False
|
| 842 |
+
841,symmetric_reflexion,241,research,0.924,0.93,1,0.639,False,False
|
| 843 |
+
842,symmetric_reflexion,242,analysis,0.769,0.95,1,0.6405,False,False
|
| 844 |
+
843,symmetric_reflexion,243,planning,0.88,0.9,1,0.642,False,False
|
| 845 |
+
844,symmetric_reflexion,244,coding,0.726,0.93,1,0.6434,False,False
|
| 846 |
+
845,symmetric_reflexion,245,research,0.746,0.9,1,0.6449,False,False
|
| 847 |
+
846,symmetric_reflexion,246,analysis,0.922,0.16,0,0.6423,False,False
|
| 848 |
+
847,symmetric_reflexion,247,planning,0.887,0.9,1,0.6437,False,False
|
| 849 |
+
848,symmetric_reflexion,248,coding,0.886,0.34,0,0.6411,False,False
|
| 850 |
+
849,symmetric_reflexion,249,research,0.847,0.94,1,0.6426,False,False
|
| 851 |
+
850,symmetric_reflexion,250,analysis,0.775,0.89,1,0.644,False,False
|
| 852 |
+
851,symmetric_reflexion,251,planning,0.864,0.87,1,0.6454,False,False
|
| 853 |
+
852,symmetric_reflexion,252,coding,0.922,0.91,1,0.6468,False,False
|
| 854 |
+
853,symmetric_reflexion,253,research,0.769,0.85,1,0.6482,False,False
|
| 855 |
+
854,symmetric_reflexion,254,analysis,0.759,0.21,0,0.6457,False,False
|
| 856 |
+
855,symmetric_reflexion,255,planning,0.929,0.9,1,0.6471,False,False
|
| 857 |
+
856,symmetric_reflexion,256,coding,0.848,0.94,1,0.6484,False,False
|
| 858 |
+
857,symmetric_reflexion,257,research,0.782,0.96,1,0.6498,False,False
|
| 859 |
+
858,symmetric_reflexion,258,analysis,0.928,0.23,0,0.6473,False,False
|
| 860 |
+
859,symmetric_reflexion,259,planning,0.892,0.91,1,0.6486,False,False
|
| 861 |
+
860,symmetric_reflexion,260,coding,0.765,0.87,1,0.65,False,False
|
| 862 |
+
861,symmetric_reflexion,261,research,0.793,0.19,0,0.6475,False,False
|
| 863 |
+
862,symmetric_reflexion,262,analysis,0.736,0.96,1,0.6489,False,False
|
| 864 |
+
863,symmetric_reflexion,263,planning,0.832,0.95,1,0.6502,False,False
|
| 865 |
+
864,symmetric_reflexion,264,coding,0.904,0.93,1,0.6515,False,False
|
| 866 |
+
865,symmetric_reflexion,265,research,0.89,0.87,1,0.6528,False,False
|
| 867 |
+
866,symmetric_reflexion,266,analysis,0.913,0.88,1,0.6541,False,False
|
| 868 |
+
867,symmetric_reflexion,267,planning,0.814,0.87,1,0.6554,False,False
|
| 869 |
+
868,symmetric_reflexion,268,coding,0.888,0.9,1,0.6567,False,False
|
| 870 |
+
869,symmetric_reflexion,269,research,0.835,0.97,1,0.658,False,False
|
| 871 |
+
870,symmetric_reflexion,270,analysis,0.77,0.89,1,0.6593,False,False
|
| 872 |
+
871,symmetric_reflexion,271,planning,0.771,0.94,1,0.6605,False,False
|
| 873 |
+
872,symmetric_reflexion,272,coding,0.933,0.93,1,0.6618,False,False
|
| 874 |
+
873,symmetric_reflexion,273,research,0.883,0.23,0,0.6593,False,False
|
| 875 |
+
874,symmetric_reflexion,274,analysis,0.787,0.94,1,0.6606,False,False
|
| 876 |
+
875,symmetric_reflexion,275,planning,0.9,0.89,1,0.6618,False,False
|
| 877 |
+
876,symmetric_reflexion,276,coding,0.918,0.97,1,0.663,False,False
|
| 878 |
+
877,symmetric_reflexion,277,research,0.886,0.92,1,0.6643,False,False
|
| 879 |
+
878,symmetric_reflexion,278,analysis,0.865,0.92,1,0.6655,False,False
|
| 880 |
+
879,symmetric_reflexion,279,planning,0.876,0.94,1,0.6667,False,False
|
| 881 |
+
880,symmetric_reflexion,280,coding,0.848,0.16,0,0.6643,False,False
|
| 882 |
+
881,symmetric_reflexion,281,research,0.778,0.89,1,0.6655,False,False
|
| 883 |
+
882,symmetric_reflexion,282,analysis,0.877,0.86,1,0.6667,False,False
|
| 884 |
+
883,symmetric_reflexion,283,planning,0.833,0.89,1,0.6678,False,False
|
| 885 |
+
884,symmetric_reflexion,284,coding,0.925,0.93,1,0.669,False,False
|
| 886 |
+
885,symmetric_reflexion,285,research,0.877,0.96,1,0.6702,False,False
|
| 887 |
+
886,symmetric_reflexion,286,analysis,0.873,0.95,1,0.6713,False,False
|
| 888 |
+
887,symmetric_reflexion,287,planning,0.78,0.87,1,0.6725,False,False
|
| 889 |
+
888,symmetric_reflexion,288,coding,0.796,0.97,1,0.6736,False,False
|
| 890 |
+
889,symmetric_reflexion,289,research,0.908,0.94,1,0.6747,False,False
|
| 891 |
+
890,symmetric_reflexion,290,analysis,0.844,0.25,0,0.6724,False,False
|
| 892 |
+
891,symmetric_reflexion,291,planning,0.804,0.94,1,0.6735,False,False
|
| 893 |
+
892,symmetric_reflexion,292,coding,0.882,0.85,1,0.6747,False,False
|
| 894 |
+
893,symmetric_reflexion,293,research,0.905,0.93,1,0.6758,False,False
|
| 895 |
+
894,symmetric_reflexion,294,analysis,0.933,0.88,1,0.6769,False,False
|
| 896 |
+
895,symmetric_reflexion,295,planning,0.875,0.92,1,0.678,False,False
|
| 897 |
+
896,symmetric_reflexion,296,coding,0.933,0.91,1,0.6791,False,False
|
| 898 |
+
897,symmetric_reflexion,297,research,0.878,0.19,0,0.6768,False,False
|
| 899 |
+
898,symmetric_reflexion,298,analysis,0.896,0.9,1,0.6779,False,False
|
| 900 |
+
899,symmetric_reflexion,299,planning,0.749,0.18,0,0.6756,False,False
|
| 901 |
+
900,symmetric_reflexion,300,coding,0.788,0.95,1,0.6767,False,False
|
| 902 |
+
901,adaptive_bayesian_lcb,1,research,0.868,0.88,1,1.0,False,False
|
| 903 |
+
902,adaptive_bayesian_lcb,2,analysis,0.857,0.95,1,1.0,False,False
|
| 904 |
+
903,adaptive_bayesian_lcb,3,planning,0.919,0.93,1,1.0,False,False
|
| 905 |
+
904,adaptive_bayesian_lcb,4,coding,0.731,0.88,1,1.0,False,False
|
| 906 |
+
905,adaptive_bayesian_lcb,5,research,0.787,0.92,1,1.0,False,False
|
| 907 |
+
906,adaptive_bayesian_lcb,6,analysis,0.793,0.9,1,1.0,False,False
|
| 908 |
+
907,adaptive_bayesian_lcb,7,planning,0.735,0.88,1,1.0,False,False
|
| 909 |
+
908,adaptive_bayesian_lcb,8,coding,0.815,0.89,1,1.0,False,False
|
| 910 |
+
909,adaptive_bayesian_lcb,9,research,0.732,0.96,1,1.0,False,False
|
| 911 |
+
910,adaptive_bayesian_lcb,10,analysis,0.861,0.93,1,1.0,False,False
|
| 912 |
+
911,adaptive_bayesian_lcb,11,planning,0.764,0.94,1,1.0,False,False
|
| 913 |
+
912,adaptive_bayesian_lcb,12,coding,0.742,0.88,1,1.0,False,False
|
| 914 |
+
913,adaptive_bayesian_lcb,13,research,0.815,0.16,0,0.9231,False,False
|
| 915 |
+
914,adaptive_bayesian_lcb,14,analysis,0.834,0.97,1,0.9286,False,False
|
| 916 |
+
915,adaptive_bayesian_lcb,15,planning,0.745,0.94,1,0.9333,False,False
|
| 917 |
+
916,adaptive_bayesian_lcb,16,coding,0.875,0.89,1,0.9375,False,False
|
| 918 |
+
917,adaptive_bayesian_lcb,17,research,0.807,0.87,1,0.9412,False,False
|
| 919 |
+
918,adaptive_bayesian_lcb,18,analysis,0.826,0.88,1,0.9444,False,False
|
| 920 |
+
919,adaptive_bayesian_lcb,19,planning,0.864,0.27,0,0.8947,False,False
|
| 921 |
+
920,adaptive_bayesian_lcb,20,coding,0.737,0.96,1,0.9,False,False
|
| 922 |
+
921,adaptive_bayesian_lcb,21,research,0.785,0.92,1,0.9048,False,False
|
| 923 |
+
922,adaptive_bayesian_lcb,22,analysis,0.857,0.88,1,0.9091,False,False
|
| 924 |
+
923,adaptive_bayesian_lcb,23,planning,0.723,0.2,0,0.8696,False,False
|
| 925 |
+
924,adaptive_bayesian_lcb,24,coding,0.869,0.92,1,0.875,False,False
|
| 926 |
+
925,adaptive_bayesian_lcb,25,research,0.789,0.92,1,0.88,False,False
|
| 927 |
+
926,adaptive_bayesian_lcb,26,analysis,0.911,0.17,0,0.8462,False,False
|
| 928 |
+
927,adaptive_bayesian_lcb,27,planning,0.754,0.3,0,0.8148,False,False
|
| 929 |
+
928,adaptive_bayesian_lcb,28,coding,0.914,0.92,1,0.8214,False,False
|
| 930 |
+
929,adaptive_bayesian_lcb,29,research,0.874,0.9,1,0.8276,False,False
|
| 931 |
+
930,adaptive_bayesian_lcb,30,analysis,0.723,0.88,1,0.8333,False,False
|
| 932 |
+
931,adaptive_bayesian_lcb,31,planning,0.819,0.23,0,0.8065,False,False
|
| 933 |
+
932,adaptive_bayesian_lcb,32,coding,0.905,0.93,1,0.8125,False,False
|
| 934 |
+
933,adaptive_bayesian_lcb,33,research,0.935,0.85,1,0.8182,False,False
|
| 935 |
+
934,adaptive_bayesian_lcb,34,analysis,0.815,0.94,1,0.8235,False,False
|
| 936 |
+
935,adaptive_bayesian_lcb,35,planning,0.921,0.88,1,0.8286,False,False
|
| 937 |
+
936,adaptive_bayesian_lcb,36,coding,0.816,0.85,1,0.8333,False,False
|
| 938 |
+
937,adaptive_bayesian_lcb,37,research,0.85,0.93,1,0.8378,False,False
|
| 939 |
+
938,adaptive_bayesian_lcb,38,analysis,0.773,0.86,1,0.8421,False,False
|
| 940 |
+
939,adaptive_bayesian_lcb,39,planning,0.764,0.94,1,0.8462,False,False
|
| 941 |
+
940,adaptive_bayesian_lcb,40,coding,0.723,0.88,1,0.85,False,False
|
| 942 |
+
941,adaptive_bayesian_lcb,41,research,0.78,0.86,1,0.8537,False,False
|
| 943 |
+
942,adaptive_bayesian_lcb,42,analysis,0.821,0.92,1,0.8571,False,False
|
| 944 |
+
943,adaptive_bayesian_lcb,43,planning,0.868,0.96,1,0.8605,False,False
|
| 945 |
+
944,adaptive_bayesian_lcb,44,coding,0.904,0.95,1,0.8636,False,False
|
| 946 |
+
945,adaptive_bayesian_lcb,45,research,0.925,0.87,1,0.8667,False,False
|
| 947 |
+
946,adaptive_bayesian_lcb,46,analysis,0.856,0.94,1,0.8696,False,False
|
| 948 |
+
947,adaptive_bayesian_lcb,47,planning,0.835,0.89,1,0.8723,False,False
|
| 949 |
+
948,adaptive_bayesian_lcb,48,coding,0.923,0.91,1,0.875,False,False
|
| 950 |
+
949,adaptive_bayesian_lcb,49,research,0.779,0.96,1,0.8776,False,False
|
| 951 |
+
950,adaptive_bayesian_lcb,50,analysis,0.867,0.9,1,0.88,False,False
|
| 952 |
+
951,adaptive_bayesian_lcb,51,planning,0.859,0.93,1,0.8824,False,False
|
| 953 |
+
952,adaptive_bayesian_lcb,52,coding,0.814,0.93,1,0.8846,False,False
|
| 954 |
+
953,adaptive_bayesian_lcb,53,research,0.926,0.95,1,0.8868,False,False
|
| 955 |
+
954,adaptive_bayesian_lcb,54,analysis,0.784,0.85,1,0.8889,False,False
|
| 956 |
+
955,adaptive_bayesian_lcb,55,planning,0.786,0.86,1,0.8909,False,False
|
| 957 |
+
956,adaptive_bayesian_lcb,56,coding,0.828,0.17,0,0.875,False,False
|
| 958 |
+
957,adaptive_bayesian_lcb,57,research,0.888,0.93,1,0.8772,False,False
|
| 959 |
+
958,adaptive_bayesian_lcb,58,analysis,0.777,0.87,1,0.8793,False,False
|
| 960 |
+
959,adaptive_bayesian_lcb,59,planning,0.736,0.93,1,0.8814,False,False
|
| 961 |
+
960,adaptive_bayesian_lcb,60,coding,0.914,0.29,0,0.8667,True,False
|
| 962 |
+
961,adaptive_bayesian_lcb,61,research,0.744,0.89,1,0.8689,True,False
|
| 963 |
+
962,adaptive_bayesian_lcb,62,analysis,0.775,0.26,0,0.8548,True,False
|
| 964 |
+
963,adaptive_bayesian_lcb,63,planning,0.799,0.32,0,0.8413,True,False
|
| 965 |
+
964,adaptive_bayesian_lcb,64,coding,0.894,0.33,0,0.8281,True,False
|
| 966 |
+
965,adaptive_bayesian_lcb,65,research,0.93,0.22,0,0.8154,True,False
|
| 967 |
+
966,adaptive_bayesian_lcb,66,analysis,0.831,0.33,0,0.803,True,False
|
| 968 |
+
967,adaptive_bayesian_lcb,67,planning,0.743,0.26,0,0.791,True,False
|
| 969 |
+
968,adaptive_bayesian_lcb,68,coding,0.831,0.95,1,0.7941,True,False
|
| 970 |
+
969,adaptive_bayesian_lcb,69,research,0.869,0.32,0,0.7826,True,False
|
| 971 |
+
970,adaptive_bayesian_lcb,70,analysis,0.885,0.27,0,0.7714,True,False
|
| 972 |
+
971,adaptive_bayesian_lcb,71,planning,0.755,0.19,0,0.7606,True,False
|
| 973 |
+
972,adaptive_bayesian_lcb,72,coding,0.873,0.86,1,0.7639,True,False
|
| 974 |
+
973,adaptive_bayesian_lcb,73,research,0.756,0.94,1,0.7671,True,False
|
| 975 |
+
974,adaptive_bayesian_lcb,74,analysis,0.881,0.18,0,0.7568,True,False
|
| 976 |
+
975,adaptive_bayesian_lcb,75,planning,0.738,0.87,1,0.76,True,False
|
| 977 |
+
976,adaptive_bayesian_lcb,76,coding,0.916,0.89,1,0.7632,True,False
|
| 978 |
+
977,adaptive_bayesian_lcb,77,research,0.743,0.91,1,0.7662,True,False
|
| 979 |
+
978,adaptive_bayesian_lcb,78,analysis,0.854,0.86,1,0.7692,True,False
|
| 980 |
+
979,adaptive_bayesian_lcb,79,planning,0.806,0.88,1,0.7722,True,False
|
| 981 |
+
980,adaptive_bayesian_lcb,80,coding,0.931,0.26,0,0.7625,True,False
|
| 982 |
+
981,adaptive_bayesian_lcb,81,research,0.811,0.26,0,0.7531,True,False
|
| 983 |
+
982,adaptive_bayesian_lcb,82,analysis,0.873,0.18,0,0.7439,True,False
|
| 984 |
+
983,adaptive_bayesian_lcb,83,planning,0.83,0.32,0,0.7349,True,False
|
| 985 |
+
984,adaptive_bayesian_lcb,84,coding,0.859,0.17,0,0.7262,True,False
|
| 986 |
+
985,adaptive_bayesian_lcb,85,research,0.853,0.89,1,0.7294,True,False
|
| 987 |
+
986,adaptive_bayesian_lcb,86,analysis,0.751,0.19,0,0.7209,True,False
|
| 988 |
+
987,adaptive_bayesian_lcb,87,planning,0.806,0.19,0,0.7126,True,False
|
| 989 |
+
988,adaptive_bayesian_lcb,88,coding,0.832,0.15,0,0.7045,True,False
|
| 990 |
+
989,adaptive_bayesian_lcb,89,research,0.894,0.91,1,0.7079,True,False
|
| 991 |
+
990,adaptive_bayesian_lcb,90,analysis,0.843,0.29,0,0.7,True,False
|
| 992 |
+
991,adaptive_bayesian_lcb,91,planning,0.776,0.94,1,0.7033,True,False
|
| 993 |
+
992,adaptive_bayesian_lcb,92,coding,0.838,0.31,0,0.6957,True,False
|
| 994 |
+
993,adaptive_bayesian_lcb,93,research,0.906,0.22,0,0.6882,True,False
|
| 995 |
+
994,adaptive_bayesian_lcb,94,analysis,0.894,0.19,0,0.6809,True,False
|
| 996 |
+
995,adaptive_bayesian_lcb,95,planning,0.908,0.24,0,0.6737,True,False
|
| 997 |
+
996,adaptive_bayesian_lcb,96,coding,0.737,0.31,0,0.6667,True,False
|
| 998 |
+
997,adaptive_bayesian_lcb,97,research,0.918,0.86,1,0.6701,True,False
|
| 999 |
+
998,adaptive_bayesian_lcb,98,analysis,0.913,0.26,0,0.6633,True,False
|
| 1000 |
+
999,adaptive_bayesian_lcb,99,planning,0.933,0.93,1,0.6667,True,False
|
| 1001 |
+
1000,adaptive_bayesian_lcb,100,coding,0.736,0.31,0,0.66,True,False
|
| 1002 |
+
1001,adaptive_bayesian_lcb,101,research,0.815,0.26,0,0.6535,True,False
|
| 1003 |
+
1002,adaptive_bayesian_lcb,102,analysis,0.791,0.89,1,0.6569,True,False
|
| 1004 |
+
1003,adaptive_bayesian_lcb,103,planning,0.802,0.89,1,0.6602,True,False
|
| 1005 |
+
1004,adaptive_bayesian_lcb,104,coding,0.822,0.28,0,0.6538,True,False
|
| 1006 |
+
1005,adaptive_bayesian_lcb,105,research,0.876,0.88,1,0.6571,True,False
|
| 1007 |
+
1006,adaptive_bayesian_lcb,106,analysis,0.866,0.15,0,0.6509,True,False
|
| 1008 |
+
1007,adaptive_bayesian_lcb,107,planning,0.897,0.26,0,0.6449,True,False
|
| 1009 |
+
1008,adaptive_bayesian_lcb,108,coding,0.735,0.27,0,0.6389,True,False
|
| 1010 |
+
1009,adaptive_bayesian_lcb,109,research,0.892,0.31,0,0.633,True,False
|
| 1011 |
+
1010,adaptive_bayesian_lcb,110,analysis,0.834,0.93,1,0.6364,True,False
|
| 1012 |
+
1011,adaptive_bayesian_lcb,111,planning,0.857,0.18,0,0.6306,True,False
|
| 1013 |
+
1012,adaptive_bayesian_lcb,112,coding,0.763,0.3,0,0.625,True,False
|
| 1014 |
+
1013,adaptive_bayesian_lcb,113,research,0.92,0.27,0,0.6195,True,True
|
| 1015 |
+
1014,adaptive_bayesian_lcb,114,analysis,0.864,0.27,0,0.614,True,True
|
| 1016 |
+
1015,adaptive_bayesian_lcb,115,planning,0.859,0.91,1,0.6174,True,True
|
| 1017 |
+
1016,adaptive_bayesian_lcb,116,coding,0.878,0.87,1,0.6207,True,True
|
| 1018 |
+
1017,adaptive_bayesian_lcb,117,research,0.789,0.88,1,0.6239,True,True
|
| 1019 |
+
1018,adaptive_bayesian_lcb,118,analysis,0.813,0.25,0,0.6186,True,True
|
| 1020 |
+
1019,adaptive_bayesian_lcb,119,planning,0.761,0.93,1,0.6218,True,True
|
| 1021 |
+
1020,adaptive_bayesian_lcb,120,coding,0.804,0.93,1,0.625,True,True
|
| 1022 |
+
1021,adaptive_bayesian_lcb,121,research,0.895,0.93,1,0.6281,True,True
|
| 1023 |
+
1022,adaptive_bayesian_lcb,122,analysis,0.778,0.28,0,0.623,True,True
|
| 1024 |
+
1023,adaptive_bayesian_lcb,123,planning,0.791,0.87,1,0.626,True,True
|
| 1025 |
+
1024,adaptive_bayesian_lcb,124,coding,0.873,0.92,1,0.629,True,True
|
| 1026 |
+
1025,adaptive_bayesian_lcb,125,research,0.778,0.95,1,0.632,True,True
|
| 1027 |
+
1026,adaptive_bayesian_lcb,126,analysis,0.891,0.87,1,0.6349,True,True
|
| 1028 |
+
1027,adaptive_bayesian_lcb,127,planning,0.739,0.89,1,0.6378,True,True
|
| 1029 |
+
1028,adaptive_bayesian_lcb,128,coding,0.815,0.88,1,0.6406,True,True
|
| 1030 |
+
1029,adaptive_bayesian_lcb,129,research,0.727,0.88,1,0.6434,True,True
|
| 1031 |
+
1030,adaptive_bayesian_lcb,130,analysis,0.843,0.93,1,0.6462,True,True
|
| 1032 |
+
1031,adaptive_bayesian_lcb,131,planning,0.791,0.33,0,0.6412,True,True
|
| 1033 |
+
1032,adaptive_bayesian_lcb,132,coding,0.792,0.35,0,0.6364,True,True
|
| 1034 |
+
1033,adaptive_bayesian_lcb,133,research,0.902,0.88,1,0.6391,True,True
|
| 1035 |
+
1034,adaptive_bayesian_lcb,134,analysis,0.847,0.86,1,0.6418,True,True
|
| 1036 |
+
1035,adaptive_bayesian_lcb,135,planning,0.94,0.94,1,0.6444,True,True
|
| 1037 |
+
1036,adaptive_bayesian_lcb,136,coding,0.897,0.97,1,0.6471,True,True
|
| 1038 |
+
1037,adaptive_bayesian_lcb,137,research,0.773,0.9,1,0.6496,True,True
|
| 1039 |
+
1038,adaptive_bayesian_lcb,138,analysis,0.749,0.89,1,0.6522,True,True
|
| 1040 |
+
1039,adaptive_bayesian_lcb,139,planning,0.892,0.89,1,0.6547,True,True
|
| 1041 |
+
1040,adaptive_bayesian_lcb,140,coding,0.864,0.85,1,0.6571,True,True
|
| 1042 |
+
1041,adaptive_bayesian_lcb,141,research,0.888,0.94,1,0.6596,False,True
|
| 1043 |
+
1042,adaptive_bayesian_lcb,142,analysis,0.729,0.92,1,0.662,False,True
|
| 1044 |
+
1043,adaptive_bayesian_lcb,143,planning,0.844,0.95,1,0.6643,False,True
|
| 1045 |
+
1044,adaptive_bayesian_lcb,144,coding,0.849,0.97,1,0.6667,False,True
|
| 1046 |
+
1045,adaptive_bayesian_lcb,145,research,0.886,0.93,1,0.669,False,True
|
| 1047 |
+
1046,adaptive_bayesian_lcb,146,analysis,0.806,0.92,1,0.6712,False,True
|
| 1048 |
+
1047,adaptive_bayesian_lcb,147,planning,0.924,0.22,0,0.6667,False,True
|
| 1049 |
+
1048,adaptive_bayesian_lcb,148,coding,0.836,0.97,1,0.6689,False,True
|
| 1050 |
+
1049,adaptive_bayesian_lcb,149,research,0.936,0.95,1,0.6711,False,True
|
| 1051 |
+
1050,adaptive_bayesian_lcb,150,analysis,0.877,0.86,1,0.6733,False,True
|
| 1052 |
+
1051,adaptive_bayesian_lcb,151,planning,0.82,0.93,1,0.6755,False,True
|
| 1053 |
+
1052,adaptive_bayesian_lcb,152,coding,0.802,0.18,0,0.6711,False,True
|
| 1054 |
+
1053,adaptive_bayesian_lcb,153,research,0.83,0.93,1,0.6732,False,True
|
| 1055 |
+
1054,adaptive_bayesian_lcb,154,analysis,0.863,0.87,1,0.6753,False,True
|
| 1056 |
+
1055,adaptive_bayesian_lcb,155,planning,0.86,0.87,1,0.6774,False,True
|
| 1057 |
+
1056,adaptive_bayesian_lcb,156,coding,0.875,0.93,1,0.6795,False,True
|
| 1058 |
+
1057,adaptive_bayesian_lcb,157,research,0.904,0.85,1,0.6815,False,True
|
| 1059 |
+
1058,adaptive_bayesian_lcb,158,analysis,0.891,0.93,1,0.6835,False,True
|
| 1060 |
+
1059,adaptive_bayesian_lcb,159,planning,0.904,0.97,1,0.6855,False,True
|
| 1061 |
+
1060,adaptive_bayesian_lcb,160,coding,0.838,0.9,1,0.6875,False,True
|
| 1062 |
+
1061,adaptive_bayesian_lcb,161,research,0.754,0.88,1,0.6894,False,True
|
| 1063 |
+
1062,adaptive_bayesian_lcb,162,analysis,0.923,0.92,1,0.6914,False,True
|
| 1064 |
+
1063,adaptive_bayesian_lcb,163,planning,0.798,0.85,1,0.6933,False,True
|
| 1065 |
+
1064,adaptive_bayesian_lcb,164,coding,0.813,0.92,1,0.6951,False,True
|
| 1066 |
+
1065,adaptive_bayesian_lcb,165,research,0.914,0.28,0,0.6909,False,True
|
| 1067 |
+
1066,adaptive_bayesian_lcb,166,analysis,0.766,0.96,1,0.6928,False,True
|
| 1068 |
+
1067,adaptive_bayesian_lcb,167,planning,0.763,0.88,1,0.6946,False,True
|
| 1069 |
+
1068,adaptive_bayesian_lcb,168,coding,0.897,0.16,0,0.6905,False,True
|
| 1070 |
+
1069,adaptive_bayesian_lcb,169,research,0.917,0.97,1,0.6923,False,True
|
| 1071 |
+
1070,adaptive_bayesian_lcb,170,analysis,0.822,0.86,1,0.6941,False,True
|
| 1072 |
+
1071,adaptive_bayesian_lcb,171,planning,0.794,0.97,1,0.6959,False,True
|
| 1073 |
+
1072,adaptive_bayesian_lcb,172,coding,0.9,0.96,1,0.6977,False,True
|
| 1074 |
+
1073,adaptive_bayesian_lcb,173,research,0.739,0.86,1,0.6994,False,True
|
| 1075 |
+
1074,adaptive_bayesian_lcb,174,analysis,0.766,0.91,1,0.7011,False,True
|
| 1076 |
+
1075,adaptive_bayesian_lcb,175,planning,0.779,0.87,1,0.7029,False,True
|
| 1077 |
+
1076,adaptive_bayesian_lcb,176,coding,0.752,0.3,0,0.6989,False,True
|
| 1078 |
+
1077,adaptive_bayesian_lcb,177,research,0.933,0.88,1,0.7006,False,True
|
| 1079 |
+
1078,adaptive_bayesian_lcb,178,analysis,0.896,0.89,1,0.7022,False,True
|
| 1080 |
+
1079,adaptive_bayesian_lcb,179,planning,0.771,0.88,1,0.7039,False,True
|
| 1081 |
+
1080,adaptive_bayesian_lcb,180,coding,0.798,0.86,1,0.7056,False,True
|
| 1082 |
+
1081,adaptive_bayesian_lcb,181,research,0.766,0.87,1,0.7072,False,True
|
| 1083 |
+
1082,adaptive_bayesian_lcb,182,analysis,0.795,0.87,1,0.7088,False,True
|
| 1084 |
+
1083,adaptive_bayesian_lcb,183,planning,0.738,0.89,1,0.7104,False,True
|
| 1085 |
+
1084,adaptive_bayesian_lcb,184,coding,0.844,0.87,1,0.712,False,True
|
| 1086 |
+
1085,adaptive_bayesian_lcb,185,research,0.848,0.87,1,0.7135,False,True
|
| 1087 |
+
1086,adaptive_bayesian_lcb,186,analysis,0.857,0.91,1,0.7151,False,True
|
| 1088 |
+
1087,adaptive_bayesian_lcb,187,planning,0.738,0.89,1,0.7166,False,True
|
| 1089 |
+
1088,adaptive_bayesian_lcb,188,coding,0.901,0.9,1,0.7181,False,True
|
| 1090 |
+
1089,adaptive_bayesian_lcb,189,research,0.821,0.92,1,0.7196,False,True
|
| 1091 |
+
1090,adaptive_bayesian_lcb,190,analysis,0.867,0.95,1,0.7211,False,True
|
| 1092 |
+
1091,adaptive_bayesian_lcb,191,planning,0.789,0.95,1,0.7225,False,True
|
| 1093 |
+
1092,adaptive_bayesian_lcb,192,coding,0.938,0.22,0,0.7188,False,True
|
| 1094 |
+
1093,adaptive_bayesian_lcb,193,research,0.763,0.94,1,0.7202,False,True
|
| 1095 |
+
1094,adaptive_bayesian_lcb,194,analysis,0.828,0.95,1,0.7216,False,True
|
| 1096 |
+
1095,adaptive_bayesian_lcb,195,planning,0.8,0.9,1,0.7231,False,True
|
| 1097 |
+
1096,adaptive_bayesian_lcb,196,coding,0.792,0.94,1,0.7245,False,True
|
| 1098 |
+
1097,adaptive_bayesian_lcb,197,research,0.748,0.96,1,0.7259,False,True
|
| 1099 |
+
1098,adaptive_bayesian_lcb,198,analysis,0.759,0.92,1,0.7273,False,True
|
| 1100 |
+
1099,adaptive_bayesian_lcb,199,planning,0.828,0.88,1,0.7286,False,True
|
| 1101 |
+
1100,adaptive_bayesian_lcb,200,coding,0.842,0.93,1,0.73,False,True
|
| 1102 |
+
1101,adaptive_bayesian_lcb,201,research,0.751,0.87,1,0.7313,False,True
|
| 1103 |
+
1102,adaptive_bayesian_lcb,202,analysis,0.781,0.87,1,0.7327,False,True
|
| 1104 |
+
1103,adaptive_bayesian_lcb,203,planning,0.902,0.96,1,0.734,False,True
|
| 1105 |
+
1104,adaptive_bayesian_lcb,204,coding,0.933,0.87,1,0.7353,False,True
|
| 1106 |
+
1105,adaptive_bayesian_lcb,205,research,0.802,0.89,1,0.7366,False,True
|
| 1107 |
+
1106,adaptive_bayesian_lcb,206,analysis,0.739,0.95,1,0.7379,False,True
|
| 1108 |
+
1107,adaptive_bayesian_lcb,207,planning,0.895,0.93,1,0.7391,False,True
|
| 1109 |
+
1108,adaptive_bayesian_lcb,208,coding,0.769,0.95,1,0.7404,False,True
|
| 1110 |
+
1109,adaptive_bayesian_lcb,209,research,0.775,0.85,1,0.7416,False,True
|
| 1111 |
+
1110,adaptive_bayesian_lcb,210,analysis,0.912,0.93,1,0.7429,False,True
|
| 1112 |
+
1111,adaptive_bayesian_lcb,211,planning,0.885,0.9,1,0.7441,False,True
|
| 1113 |
+
1112,adaptive_bayesian_lcb,212,coding,0.797,0.91,1,0.7453,False,True
|
| 1114 |
+
1113,adaptive_bayesian_lcb,213,research,0.923,0.88,1,0.7465,False,True
|
| 1115 |
+
1114,adaptive_bayesian_lcb,214,analysis,0.766,0.96,1,0.7477,False,True
|
| 1116 |
+
1115,adaptive_bayesian_lcb,215,planning,0.823,0.94,1,0.7488,False,True
|
| 1117 |
+
1116,adaptive_bayesian_lcb,216,coding,0.754,0.9,1,0.75,False,True
|
| 1118 |
+
1117,adaptive_bayesian_lcb,217,research,0.851,0.3,0,0.7465,False,True
|
| 1119 |
+
1118,adaptive_bayesian_lcb,218,analysis,0.808,0.87,1,0.7477,False,True
|
| 1120 |
+
1119,adaptive_bayesian_lcb,219,planning,0.727,0.89,1,0.7489,False,True
|
| 1121 |
+
1120,adaptive_bayesian_lcb,220,coding,0.832,0.96,1,0.75,False,True
|
| 1122 |
+
1121,adaptive_bayesian_lcb,221,research,0.832,0.86,1,0.7511,False,True
|
| 1123 |
+
1122,adaptive_bayesian_lcb,222,analysis,0.728,0.9,1,0.7523,False,True
|
| 1124 |
+
1123,adaptive_bayesian_lcb,223,planning,0.905,0.85,1,0.7534,False,True
|
| 1125 |
+
1124,adaptive_bayesian_lcb,224,coding,0.819,0.86,1,0.7545,False,True
|
| 1126 |
+
1125,adaptive_bayesian_lcb,225,research,0.879,0.92,1,0.7556,False,True
|
| 1127 |
+
1126,adaptive_bayesian_lcb,226,analysis,0.782,0.9,1,0.7566,False,True
|
| 1128 |
+
1127,adaptive_bayesian_lcb,227,planning,0.896,0.94,1,0.7577,False,True
|
| 1129 |
+
1128,adaptive_bayesian_lcb,228,coding,0.748,0.88,1,0.7588,False,True
|
| 1130 |
+
1129,adaptive_bayesian_lcb,229,research,0.869,0.96,1,0.7598,False,True
|
| 1131 |
+
1130,adaptive_bayesian_lcb,230,analysis,0.805,0.85,1,0.7609,False,True
|
| 1132 |
+
1131,adaptive_bayesian_lcb,231,planning,0.902,0.94,1,0.7619,False,True
|
| 1133 |
+
1132,adaptive_bayesian_lcb,232,coding,0.772,0.85,1,0.7629,False,True
|
| 1134 |
+
1133,adaptive_bayesian_lcb,233,research,0.932,0.96,1,0.7639,False,True
|
| 1135 |
+
1134,adaptive_bayesian_lcb,234,analysis,0.778,0.93,1,0.765,False,True
|
| 1136 |
+
1135,adaptive_bayesian_lcb,235,planning,0.79,0.96,1,0.766,False,True
|
| 1137 |
+
1136,adaptive_bayesian_lcb,236,coding,0.915,0.88,1,0.7669,False,True
|
| 1138 |
+
1137,adaptive_bayesian_lcb,237,research,0.782,0.15,0,0.7637,False,True
|
| 1139 |
+
1138,adaptive_bayesian_lcb,238,analysis,0.878,0.92,1,0.7647,False,True
|
| 1140 |
+
1139,adaptive_bayesian_lcb,239,planning,0.938,0.89,1,0.7657,False,True
|
| 1141 |
+
1140,adaptive_bayesian_lcb,240,coding,0.737,0.88,1,0.7667,False,True
|
| 1142 |
+
1141,adaptive_bayesian_lcb,241,research,0.796,0.96,1,0.7676,False,True
|
| 1143 |
+
1142,adaptive_bayesian_lcb,242,analysis,0.761,0.96,1,0.7686,False,True
|
| 1144 |
+
1143,adaptive_bayesian_lcb,243,planning,0.734,0.87,1,0.7695,False,True
|
| 1145 |
+
1144,adaptive_bayesian_lcb,244,coding,0.851,0.97,1,0.7705,False,True
|
| 1146 |
+
1145,adaptive_bayesian_lcb,245,research,0.818,0.88,1,0.7714,False,True
|
| 1147 |
+
1146,adaptive_bayesian_lcb,246,analysis,0.824,0.94,1,0.7724,False,True
|
| 1148 |
+
1147,adaptive_bayesian_lcb,247,planning,0.886,0.96,1,0.7733,False,True
|
| 1149 |
+
1148,adaptive_bayesian_lcb,248,coding,0.9,0.86,1,0.7742,False,True
|
| 1150 |
+
1149,adaptive_bayesian_lcb,249,research,0.722,0.93,1,0.7751,False,True
|
| 1151 |
+
1150,adaptive_bayesian_lcb,250,analysis,0.81,0.96,1,0.776,False,True
|
| 1152 |
+
1151,adaptive_bayesian_lcb,251,planning,0.917,0.21,0,0.7729,False,True
|
| 1153 |
+
1152,adaptive_bayesian_lcb,252,coding,0.872,0.87,1,0.7738,False,True
|
| 1154 |
+
1153,adaptive_bayesian_lcb,253,research,0.761,0.9,1,0.7747,False,True
|
| 1155 |
+
1154,adaptive_bayesian_lcb,254,analysis,0.903,0.94,1,0.7756,False,True
|
| 1156 |
+
1155,adaptive_bayesian_lcb,255,planning,0.837,0.91,1,0.7765,False,True
|
| 1157 |
+
1156,adaptive_bayesian_lcb,256,coding,0.786,0.9,1,0.7773,False,True
|
| 1158 |
+
1157,adaptive_bayesian_lcb,257,research,0.756,0.92,1,0.7782,False,True
|
| 1159 |
+
1158,adaptive_bayesian_lcb,258,analysis,0.919,0.94,1,0.7791,False,True
|
| 1160 |
+
1159,adaptive_bayesian_lcb,259,planning,0.865,0.31,0,0.7761,False,True
|
| 1161 |
+
1160,adaptive_bayesian_lcb,260,coding,0.845,0.96,1,0.7769,False,True
|
| 1162 |
+
1161,adaptive_bayesian_lcb,261,research,0.808,0.85,1,0.7778,False,True
|
| 1163 |
+
1162,adaptive_bayesian_lcb,262,analysis,0.902,0.86,1,0.7786,False,True
|
| 1164 |
+
1163,adaptive_bayesian_lcb,263,planning,0.847,0.86,1,0.7795,False,True
|
| 1165 |
+
1164,adaptive_bayesian_lcb,264,coding,0.936,0.86,1,0.7803,False,True
|
| 1166 |
+
1165,adaptive_bayesian_lcb,265,research,0.851,0.85,1,0.7811,False,True
|
| 1167 |
+
1166,adaptive_bayesian_lcb,266,analysis,0.865,0.86,1,0.782,False,True
|
| 1168 |
+
1167,adaptive_bayesian_lcb,267,planning,0.758,0.89,1,0.7828,False,True
|
| 1169 |
+
1168,adaptive_bayesian_lcb,268,coding,0.926,0.97,1,0.7836,False,True
|
| 1170 |
+
1169,adaptive_bayesian_lcb,269,research,0.777,0.24,0,0.7807,False,True
|
| 1171 |
+
1170,adaptive_bayesian_lcb,270,analysis,0.796,0.86,1,0.7815,False,True
|
| 1172 |
+
1171,adaptive_bayesian_lcb,271,planning,0.872,0.88,1,0.7823,False,True
|
| 1173 |
+
1172,adaptive_bayesian_lcb,272,coding,0.855,0.92,1,0.7831,False,True
|
| 1174 |
+
1173,adaptive_bayesian_lcb,273,research,0.799,0.95,1,0.7839,False,True
|
| 1175 |
+
1174,adaptive_bayesian_lcb,274,analysis,0.825,0.89,1,0.7847,False,True
|
| 1176 |
+
1175,adaptive_bayesian_lcb,275,planning,0.897,0.88,1,0.7855,False,True
|
| 1177 |
+
1176,adaptive_bayesian_lcb,276,coding,0.739,0.91,1,0.7862,False,True
|
| 1178 |
+
1177,adaptive_bayesian_lcb,277,research,0.905,0.9,1,0.787,False,True
|
| 1179 |
+
1178,adaptive_bayesian_lcb,278,analysis,0.898,0.9,1,0.7878,False,True
|
| 1180 |
+
1179,adaptive_bayesian_lcb,279,planning,0.821,0.96,1,0.7885,False,True
|
| 1181 |
+
1180,adaptive_bayesian_lcb,280,coding,0.746,0.29,0,0.7857,False,True
|
| 1182 |
+
1181,adaptive_bayesian_lcb,281,research,0.837,0.91,1,0.7865,False,True
|
| 1183 |
+
1182,adaptive_bayesian_lcb,282,analysis,0.81,0.93,1,0.7872,False,True
|
| 1184 |
+
1183,adaptive_bayesian_lcb,283,planning,0.934,0.94,1,0.788,False,True
|
| 1185 |
+
1184,adaptive_bayesian_lcb,284,coding,0.735,0.86,1,0.7887,False,True
|
| 1186 |
+
1185,adaptive_bayesian_lcb,285,research,0.855,0.28,0,0.786,False,True
|
| 1187 |
+
1186,adaptive_bayesian_lcb,286,analysis,0.737,0.92,1,0.7867,False,True
|
| 1188 |
+
1187,adaptive_bayesian_lcb,287,planning,0.809,0.95,1,0.7875,False,True
|
| 1189 |
+
1188,adaptive_bayesian_lcb,288,coding,0.855,0.88,1,0.7882,False,True
|
| 1190 |
+
1189,adaptive_bayesian_lcb,289,research,0.743,0.9,1,0.7889,False,True
|
| 1191 |
+
1190,adaptive_bayesian_lcb,290,analysis,0.869,0.86,1,0.7897,False,True
|
| 1192 |
+
1191,adaptive_bayesian_lcb,291,planning,0.807,0.87,1,0.7904,False,True
|
| 1193 |
+
1192,adaptive_bayesian_lcb,292,coding,0.902,0.9,1,0.7911,False,True
|
| 1194 |
+
1193,adaptive_bayesian_lcb,293,research,0.757,0.92,1,0.7918,False,True
|
| 1195 |
+
1194,adaptive_bayesian_lcb,294,analysis,0.771,0.94,1,0.7925,False,True
|
| 1196 |
+
1195,adaptive_bayesian_lcb,295,planning,0.931,0.96,1,0.7932,False,True
|
| 1197 |
+
1196,adaptive_bayesian_lcb,296,coding,0.926,0.28,0,0.7905,False,True
|
| 1198 |
+
1197,adaptive_bayesian_lcb,297,research,0.859,0.94,1,0.7912,False,True
|
| 1199 |
+
1198,adaptive_bayesian_lcb,298,analysis,0.837,0.9,1,0.7919,False,True
|
| 1200 |
+
1199,adaptive_bayesian_lcb,299,planning,0.881,0.87,1,0.7926,False,True
|
| 1201 |
+
1200,adaptive_bayesian_lcb,300,coding,0.903,0.95,1,0.7933,False,True
|
index.html
CHANGED
|
@@ -1,19 +1,1097 @@
|
|
| 1 |
-
<!
|
| 2 |
-
<html>
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
</html>
|
|
|
|
| 1 |
+
<!DOCTYPE html>
|
| 2 |
+
<html lang="en">
|
| 3 |
+
<head>
|
| 4 |
+
<meta charset="UTF-8">
|
| 5 |
+
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
| 6 |
+
<title>Adaptive Agent Memory Resilience Playground</title>
|
| 7 |
+
<link rel="preconnect" href="https://fonts.googleapis.com">
|
| 8 |
+
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
| 9 |
+
<link href="https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&family=JetBrains+Mono:wght@400;500;600&display=swap" rel="stylesheet">
|
| 10 |
+
<script src="https://cdn.plot.ly/plotly-2.35.2.min.js"></script>
|
| 11 |
+
<style>
|
| 12 |
+
:root {
|
| 13 |
+
--bg-primary: #0f172a;
|
| 14 |
+
--bg-surface: #1e293b;
|
| 15 |
+
--bg-card: #243247;
|
| 16 |
+
--bg-card-hover: #2d3e58;
|
| 17 |
+
--border-subtle: #334155;
|
| 18 |
+
--border-active: #3b82f6;
|
| 19 |
+
--text-primary: #f8fafc;
|
| 20 |
+
--text-secondary: #94a3b8;
|
| 21 |
+
--text-muted: #64748b;
|
| 22 |
+
--accent-blue: #3b82f6;
|
| 23 |
+
--accent-indigo: #6366f1;
|
| 24 |
+
--accent-green: #10b981;
|
| 25 |
+
--accent-red: #ef4444;
|
| 26 |
+
--accent-purple: #8b5cf6;
|
| 27 |
+
--font-sans: 'Inter', -apple-system, BlinkMacSystemFont, sans-serif;
|
| 28 |
+
--font-mono: 'JetBrains Mono', monospace;
|
| 29 |
+
}
|
| 30 |
+
|
| 31 |
+
* {
|
| 32 |
+
box-sizing: border-box;
|
| 33 |
+
margin: 0;
|
| 34 |
+
padding: 0;
|
| 35 |
+
}
|
| 36 |
+
|
| 37 |
+
body {
|
| 38 |
+
background-color: var(--bg-primary);
|
| 39 |
+
color: var(--text-primary);
|
| 40 |
+
font-family: var(--font-sans);
|
| 41 |
+
line-height: 1.5;
|
| 42 |
+
-webkit-font-smoothing: antialiased;
|
| 43 |
+
padding: 24px;
|
| 44 |
+
}
|
| 45 |
+
|
| 46 |
+
.container {
|
| 47 |
+
max-width: 1240px;
|
| 48 |
+
margin: 0 auto;
|
| 49 |
+
}
|
| 50 |
+
|
| 51 |
+
header {
|
| 52 |
+
margin-bottom: 24px;
|
| 53 |
+
padding-bottom: 20px;
|
| 54 |
+
border-bottom: 1px solid var(--border-subtle);
|
| 55 |
+
}
|
| 56 |
+
|
| 57 |
+
.badge-bar {
|
| 58 |
+
display: flex;
|
| 59 |
+
gap: 10px;
|
| 60 |
+
margin-bottom: 12px;
|
| 61 |
+
flex-wrap: wrap;
|
| 62 |
+
}
|
| 63 |
+
|
| 64 |
+
.badge {
|
| 65 |
+
font-size: 12px;
|
| 66 |
+
font-weight: 600;
|
| 67 |
+
padding: 4px 10px;
|
| 68 |
+
border-radius: 6px;
|
| 69 |
+
text-transform: uppercase;
|
| 70 |
+
letter-spacing: 0.5px;
|
| 71 |
+
}
|
| 72 |
+
|
| 73 |
+
.badge-primary { background: rgba(59, 130, 246, 0.15); color: #60a5fa; border: 1px solid rgba(59, 130, 246, 0.3); }
|
| 74 |
+
.badge-success { background: rgba(16, 185, 129, 0.15); color: #34d399; border: 1px solid rgba(16, 185, 129, 0.3); }
|
| 75 |
+
.badge-muted { background: rgba(148, 163, 184, 0.15); color: #cbd5e1; border: 1px solid rgba(148, 163, 184, 0.3); }
|
| 76 |
+
|
| 77 |
+
h1 {
|
| 78 |
+
font-size: 28px;
|
| 79 |
+
font-weight: 700;
|
| 80 |
+
letter-spacing: -0.5px;
|
| 81 |
+
color: #ffffff;
|
| 82 |
+
margin-bottom: 6px;
|
| 83 |
+
}
|
| 84 |
+
|
| 85 |
+
.subtitle {
|
| 86 |
+
color: var(--text-secondary);
|
| 87 |
+
font-size: 15px;
|
| 88 |
+
max-width: 900px;
|
| 89 |
+
margin-bottom: 14px;
|
| 90 |
+
}
|
| 91 |
+
|
| 92 |
+
.meta-links {
|
| 93 |
+
display: flex;
|
| 94 |
+
gap: 16px;
|
| 95 |
+
font-size: 13px;
|
| 96 |
+
flex-wrap: wrap;
|
| 97 |
+
}
|
| 98 |
+
|
| 99 |
+
.meta-links a {
|
| 100 |
+
color: #93c5fd;
|
| 101 |
+
text-decoration: none;
|
| 102 |
+
font-weight: 500;
|
| 103 |
+
transition: color 0.15s ease;
|
| 104 |
+
}
|
| 105 |
+
|
| 106 |
+
.meta-links a:hover {
|
| 107 |
+
color: #ffffff;
|
| 108 |
+
text-decoration: underline;
|
| 109 |
+
}
|
| 110 |
+
|
| 111 |
+
/* Tabs */
|
| 112 |
+
.tabs-nav {
|
| 113 |
+
display: flex;
|
| 114 |
+
gap: 8px;
|
| 115 |
+
margin-bottom: 24px;
|
| 116 |
+
border-bottom: 1px solid var(--border-subtle);
|
| 117 |
+
padding-bottom: 4px;
|
| 118 |
+
}
|
| 119 |
+
|
| 120 |
+
.tab-btn {
|
| 121 |
+
background: transparent;
|
| 122 |
+
border: none;
|
| 123 |
+
color: var(--text-secondary);
|
| 124 |
+
font-family: var(--font-sans);
|
| 125 |
+
font-size: 14px;
|
| 126 |
+
font-weight: 600;
|
| 127 |
+
padding: 10px 18px;
|
| 128 |
+
border-radius: 8px 8px 0 0;
|
| 129 |
+
cursor: pointer;
|
| 130 |
+
transition: all 0.15s ease;
|
| 131 |
+
position: relative;
|
| 132 |
+
}
|
| 133 |
+
|
| 134 |
+
.tab-btn:hover {
|
| 135 |
+
color: var(--text-primary);
|
| 136 |
+
background: rgba(255, 255, 255, 0.04);
|
| 137 |
+
}
|
| 138 |
+
|
| 139 |
+
.tab-btn.active {
|
| 140 |
+
color: #ffffff;
|
| 141 |
+
background: var(--bg-surface);
|
| 142 |
+
border-bottom: 2px solid var(--accent-blue);
|
| 143 |
+
}
|
| 144 |
+
|
| 145 |
+
.tab-content {
|
| 146 |
+
display: none;
|
| 147 |
+
}
|
| 148 |
+
|
| 149 |
+
.tab-content.active {
|
| 150 |
+
display: block;
|
| 151 |
+
}
|
| 152 |
+
|
| 153 |
+
/* Grid Layouts */
|
| 154 |
+
.layout-2col {
|
| 155 |
+
display: grid;
|
| 156 |
+
grid-template-columns: 360px 1fr;
|
| 157 |
+
gap: 24px;
|
| 158 |
+
}
|
| 159 |
+
|
| 160 |
+
@media (max-width: 960px) {
|
| 161 |
+
.layout-2col {
|
| 162 |
+
grid-template-columns: 1fr;
|
| 163 |
+
}
|
| 164 |
+
}
|
| 165 |
+
|
| 166 |
+
.card {
|
| 167 |
+
background: var(--bg-surface);
|
| 168 |
+
border: 1px solid var(--border-subtle);
|
| 169 |
+
border-radius: 10px;
|
| 170 |
+
padding: 20px;
|
| 171 |
+
margin-bottom: 20px;
|
| 172 |
+
}
|
| 173 |
+
|
| 174 |
+
.card h3 {
|
| 175 |
+
font-size: 16px;
|
| 176 |
+
font-weight: 600;
|
| 177 |
+
margin-bottom: 16px;
|
| 178 |
+
color: #ffffff;
|
| 179 |
+
display: flex;
|
| 180 |
+
align-items: center;
|
| 181 |
+
justify-content: space-between;
|
| 182 |
+
}
|
| 183 |
+
|
| 184 |
+
/* Controls */
|
| 185 |
+
.control-group {
|
| 186 |
+
margin-bottom: 18px;
|
| 187 |
+
}
|
| 188 |
+
|
| 189 |
+
.control-label {
|
| 190 |
+
display: flex;
|
| 191 |
+
justify-content: space-between;
|
| 192 |
+
font-size: 13px;
|
| 193 |
+
font-weight: 500;
|
| 194 |
+
color: var(--text-secondary);
|
| 195 |
+
margin-bottom: 6px;
|
| 196 |
+
}
|
| 197 |
+
|
| 198 |
+
.control-val {
|
| 199 |
+
font-family: var(--font-mono);
|
| 200 |
+
font-weight: 600;
|
| 201 |
+
color: #93c5fd;
|
| 202 |
+
}
|
| 203 |
+
|
| 204 |
+
input[type="range"] {
|
| 205 |
+
width: 100%;
|
| 206 |
+
height: 6px;
|
| 207 |
+
background: #334155;
|
| 208 |
+
border-radius: 3px;
|
| 209 |
+
outline: none;
|
| 210 |
+
-webkit-appearance: none;
|
| 211 |
+
}
|
| 212 |
+
|
| 213 |
+
input[type="range"]::-webkit-slider-thumb {
|
| 214 |
+
-webkit-appearance: none;
|
| 215 |
+
width: 16px;
|
| 216 |
+
height: 16px;
|
| 217 |
+
border-radius: 50%;
|
| 218 |
+
background: var(--accent-blue);
|
| 219 |
+
cursor: pointer;
|
| 220 |
+
border: 2px solid #ffffff;
|
| 221 |
+
transition: transform 0.1s;
|
| 222 |
+
}
|
| 223 |
+
|
| 224 |
+
input[type="range"]::-webkit-slider-thumb:hover {
|
| 225 |
+
transform: scale(1.2);
|
| 226 |
+
}
|
| 227 |
+
|
| 228 |
+
/* KPI Grid */
|
| 229 |
+
.kpi-grid {
|
| 230 |
+
display: grid;
|
| 231 |
+
grid-template-columns: repeat(4, 1fr);
|
| 232 |
+
gap: 14px;
|
| 233 |
+
margin-bottom: 20px;
|
| 234 |
+
}
|
| 235 |
+
|
| 236 |
+
@media (max-width: 768px) {
|
| 237 |
+
.kpi-grid {
|
| 238 |
+
grid-template-columns: repeat(2, 1fr);
|
| 239 |
+
}
|
| 240 |
+
}
|
| 241 |
+
|
| 242 |
+
.kpi-card {
|
| 243 |
+
background: var(--bg-card);
|
| 244 |
+
border: 1px solid var(--border-subtle);
|
| 245 |
+
border-radius: 8px;
|
| 246 |
+
padding: 14px 16px;
|
| 247 |
+
}
|
| 248 |
+
|
| 249 |
+
.kpi-title {
|
| 250 |
+
font-size: 12px;
|
| 251 |
+
font-weight: 500;
|
| 252 |
+
color: var(--text-muted);
|
| 253 |
+
text-transform: uppercase;
|
| 254 |
+
letter-spacing: 0.5px;
|
| 255 |
+
margin-bottom: 6px;
|
| 256 |
+
}
|
| 257 |
+
|
| 258 |
+
.kpi-value {
|
| 259 |
+
font-family: var(--font-mono);
|
| 260 |
+
font-size: 22px;
|
| 261 |
+
font-weight: 700;
|
| 262 |
+
color: #ffffff;
|
| 263 |
+
}
|
| 264 |
+
|
| 265 |
+
/* Status Banner */
|
| 266 |
+
.status-banner {
|
| 267 |
+
padding: 14px 18px;
|
| 268 |
+
border-radius: 8px;
|
| 269 |
+
font-weight: 600;
|
| 270 |
+
font-size: 14px;
|
| 271 |
+
margin-bottom: 18px;
|
| 272 |
+
display: flex;
|
| 273 |
+
justify-content: space-between;
|
| 274 |
+
align-items: center;
|
| 275 |
+
}
|
| 276 |
+
|
| 277 |
+
.status-active {
|
| 278 |
+
background: rgba(16, 185, 129, 0.12);
|
| 279 |
+
border: 1px solid rgba(16, 185, 129, 0.4);
|
| 280 |
+
color: #34d399;
|
| 281 |
+
}
|
| 282 |
+
|
| 283 |
+
.status-quarantined {
|
| 284 |
+
background: rgba(239, 68, 68, 0.12);
|
| 285 |
+
border: 1px solid rgba(239, 68, 68, 0.4);
|
| 286 |
+
color: #f87171;
|
| 287 |
+
}
|
| 288 |
+
|
| 289 |
+
/* Chart Container */
|
| 290 |
+
#betaPlot {
|
| 291 |
+
width: 100%;
|
| 292 |
+
height: 420px;
|
| 293 |
+
border-radius: 8px;
|
| 294 |
+
background: #1e293b;
|
| 295 |
+
}
|
| 296 |
+
|
| 297 |
+
/* Tables */
|
| 298 |
+
.table-container {
|
| 299 |
+
overflow-x: auto;
|
| 300 |
+
margin-top: 12px;
|
| 301 |
+
}
|
| 302 |
+
|
| 303 |
+
table {
|
| 304 |
+
width: 100%;
|
| 305 |
+
border-collapse: collapse;
|
| 306 |
+
font-size: 13px;
|
| 307 |
+
text-align: left;
|
| 308 |
+
}
|
| 309 |
+
|
| 310 |
+
th {
|
| 311 |
+
background: var(--bg-card);
|
| 312 |
+
color: var(--text-secondary);
|
| 313 |
+
font-weight: 600;
|
| 314 |
+
padding: 10px 14px;
|
| 315 |
+
border-bottom: 1px solid var(--border-subtle);
|
| 316 |
+
font-family: var(--font-sans);
|
| 317 |
+
}
|
| 318 |
+
|
| 319 |
+
td {
|
| 320 |
+
padding: 10px 14px;
|
| 321 |
+
border-bottom: 1px solid var(--border-subtle);
|
| 322 |
+
color: var(--text-primary);
|
| 323 |
+
}
|
| 324 |
+
|
| 325 |
+
tr:hover td {
|
| 326 |
+
background: rgba(255, 255, 255, 0.02);
|
| 327 |
+
}
|
| 328 |
+
|
| 329 |
+
.cell-mono {
|
| 330 |
+
font-family: var(--font-mono);
|
| 331 |
+
font-weight: 500;
|
| 332 |
+
}
|
| 333 |
+
|
| 334 |
+
.tag-q {
|
| 335 |
+
font-size: 11px;
|
| 336 |
+
font-weight: 600;
|
| 337 |
+
padding: 3px 8px;
|
| 338 |
+
border-radius: 4px;
|
| 339 |
+
display: inline-block;
|
| 340 |
+
}
|
| 341 |
+
|
| 342 |
+
.tag-active { background: rgba(16, 185, 129, 0.15); color: #34d399; border: 1px solid rgba(16, 185, 129, 0.3); }
|
| 343 |
+
.tag-quarantine { background: rgba(239, 68, 68, 0.15); color: #f87171; border: 1px solid rgba(239, 68, 68, 0.3); }
|
| 344 |
+
|
| 345 |
+
.formula-box {
|
| 346 |
+
background: #111827;
|
| 347 |
+
border: 1px solid var(--border-subtle);
|
| 348 |
+
border-radius: 8px;
|
| 349 |
+
padding: 14px 18px;
|
| 350 |
+
font-family: var(--font-mono);
|
| 351 |
+
font-size: 13px;
|
| 352 |
+
color: #93c5fd;
|
| 353 |
+
margin-bottom: 16px;
|
| 354 |
+
overflow-x: auto;
|
| 355 |
+
}
|
| 356 |
+
|
| 357 |
+
.btn {
|
| 358 |
+
background: var(--accent-blue);
|
| 359 |
+
color: #ffffff;
|
| 360 |
+
border: none;
|
| 361 |
+
padding: 8px 16px;
|
| 362 |
+
font-size: 13px;
|
| 363 |
+
font-weight: 600;
|
| 364 |
+
border-radius: 6px;
|
| 365 |
+
cursor: pointer;
|
| 366 |
+
font-family: var(--font-sans);
|
| 367 |
+
transition: background 0.15s ease;
|
| 368 |
+
}
|
| 369 |
+
|
| 370 |
+
.btn:hover {
|
| 371 |
+
background: #2563eb;
|
| 372 |
+
}
|
| 373 |
+
|
| 374 |
+
.btn-secondary {
|
| 375 |
+
background: var(--bg-card);
|
| 376 |
+
border: 1px solid var(--border-subtle);
|
| 377 |
+
color: var(--text-primary);
|
| 378 |
+
}
|
| 379 |
+
|
| 380 |
+
.btn-secondary:hover {
|
| 381 |
+
background: var(--bg-card-hover);
|
| 382 |
+
}
|
| 383 |
+
|
| 384 |
+
footer {
|
| 385 |
+
margin-top: 40px;
|
| 386 |
+
padding-top: 20px;
|
| 387 |
+
border-top: 1px solid var(--border-subtle);
|
| 388 |
+
font-size: 13px;
|
| 389 |
+
color: var(--text-muted);
|
| 390 |
+
text-align: center;
|
| 391 |
+
}
|
| 392 |
+
</style>
|
| 393 |
+
</head>
|
| 394 |
+
<body>
|
| 395 |
+
<div class="container">
|
| 396 |
+
<header>
|
| 397 |
+
<div class="badge-bar">
|
| 398 |
+
<span class="badge badge-primary">Research Benchmark</span>
|
| 399 |
+
<span class="badge badge-success">Statistical Inference Engine</span>
|
| 400 |
+
<span class="badge badge-muted">Zero Emojis Enforced</span>
|
| 401 |
+
</div>
|
| 402 |
+
<h1>Adaptive Agent Memory Resilience Playground</h1>
|
| 403 |
+
<p class="subtitle">
|
| 404 |
+
Interactive evaluation of Bayesian Beta-Bernoulli trust updating, epistemic variance quantification,
|
| 405 |
+
pessimistic Lower Confidence Bound (LCB) composite retrieval, and Theorem 1 statistical quarantine for autonomous LLM agents.
|
| 406 |
+
</p>
|
| 407 |
+
<div class="meta-links">
|
| 408 |
+
<span>Author: <strong>Sumit Das</strong> (<a href="https://huggingface.co/sumitaidev" target="_blank">@sumitaidev</a>)</span>
|
| 409 |
+
<span>Benchmark: <a href="https://huggingface.co/datasets/sumitaidev/agent-memory-resilience-benchmark" target="_blank">Hugging Face Dataset</a></span>
|
| 410 |
+
<span>Kaggle: <a href="https://www.kaggle.com/sumitdevai" target="_blank">Kaggle Benchmarks</a></span>
|
| 411 |
+
<span>Paper: <strong>arXiv:2026.xxxxx</strong></span>
|
| 412 |
+
</div>
|
| 413 |
+
</header>
|
| 414 |
+
|
| 415 |
+
<div class="tabs-nav">
|
| 416 |
+
<button class="tab-btn active" onclick="switchTab('tab1', this)">1. Bayesian Reliability & Theorem 1</button>
|
| 417 |
+
<button class="tab-btn" onclick="switchTab('tab2', this)">2. Pessimistic LCB Retrieval Playground</button>
|
| 418 |
+
<button class="tab-btn" onclick="switchTab('tab3', this)">3. Benchmark Telemetry & Empirical Ablation</button>
|
| 419 |
+
</div>
|
| 420 |
+
|
| 421 |
+
<!-- TAB 1 -->
|
| 422 |
+
<div id="tab1" class="tab-content active">
|
| 423 |
+
<div class="layout-2col">
|
| 424 |
+
<div>
|
| 425 |
+
<div class="card">
|
| 426 |
+
<h3>Prior Parameters</h3>
|
| 427 |
+
<div class="control-group">
|
| 428 |
+
<div class="control-label">
|
| 429 |
+
<span>Prior Alpha (alpha_0)</span>
|
| 430 |
+
<span class="control-val" id="val_a0">3.0</span>
|
| 431 |
+
</div>
|
| 432 |
+
<input type="range" id="input_a0" min="0.5" max="10.0" step="0.5" value="3.0" oninput="updateState()">
|
| 433 |
+
</div>
|
| 434 |
+
<div class="control-group">
|
| 435 |
+
<div class="control-label">
|
| 436 |
+
<span>Prior Beta (beta_0)</span>
|
| 437 |
+
<span class="control-val" id="val_b0">1.0</span>
|
| 438 |
+
</div>
|
| 439 |
+
<input type="range" id="input_b0" min="0.5" max="10.0" step="0.5" value="1.0" oninput="updateState()">
|
| 440 |
+
</div>
|
| 441 |
+
</div>
|
| 442 |
+
|
| 443 |
+
<div class="card">
|
| 444 |
+
<h3>Observed Experience Trials</h3>
|
| 445 |
+
<div class="control-group">
|
| 446 |
+
<div class="control-label">
|
| 447 |
+
<span>Task Successes (n_s)</span>
|
| 448 |
+
<span class="control-val" id="val_ns">0</span>
|
| 449 |
+
</div>
|
| 450 |
+
<input type="range" id="input_ns" min="0" max="50" step="1" value="0" oninput="updateState()">
|
| 451 |
+
</div>
|
| 452 |
+
<div class="control-group">
|
| 453 |
+
<div class="control-label">
|
| 454 |
+
<span>Task Failures (n_f)</span>
|
| 455 |
+
<span class="control-val" id="val_nf">0</span>
|
| 456 |
+
</div>
|
| 457 |
+
<input type="range" id="input_nf" min="0" max="20" step="1" value="0" oninput="updateState()">
|
| 458 |
+
</div>
|
| 459 |
+
</div>
|
| 460 |
+
|
| 461 |
+
<div class="card">
|
| 462 |
+
<h3>Inference & Risk Hyperparameters</h3>
|
| 463 |
+
<div class="control-group">
|
| 464 |
+
<div class="control-label">
|
| 465 |
+
<span>Risk Aversion (lambda)</span>
|
| 466 |
+
<span class="control-val" id="val_lam">1.0</span>
|
| 467 |
+
</div>
|
| 468 |
+
<input type="range" id="input_lam" min="0.0" max="3.0" step="0.2" value="1.0" oninput="updateState()">
|
| 469 |
+
</div>
|
| 470 |
+
<div class="control-group">
|
| 471 |
+
<div class="control-label">
|
| 472 |
+
<span>Admissibility Threshold (theta_0)</span>
|
| 473 |
+
<span class="control-val" id="val_thresh">0.70</span>
|
| 474 |
+
</div>
|
| 475 |
+
<input type="range" id="input_thresh" min="0.50" max="0.90" step="0.05" value="0.70" oninput="updateState()">
|
| 476 |
+
</div>
|
| 477 |
+
<div class="control-group">
|
| 478 |
+
<div class="control-label">
|
| 479 |
+
<span>Significance Level (gamma)</span>
|
| 480 |
+
<span class="control-val" id="val_gamma">0.05</span>
|
| 481 |
+
</div>
|
| 482 |
+
<input type="range" id="input_gamma" min="0.01" max="0.20" step="0.01" value="0.05" oninput="updateState()">
|
| 483 |
+
</div>
|
| 484 |
+
</div>
|
| 485 |
+
</div>
|
| 486 |
+
|
| 487 |
+
<div>
|
| 488 |
+
<div class="kpi-grid">
|
| 489 |
+
<div class="kpi-card">
|
| 490 |
+
<div class="kpi-title">Posterior Mean E[theta]</div>
|
| 491 |
+
<div class="kpi-value" id="kpi_mean">0.7500</div>
|
| 492 |
+
</div>
|
| 493 |
+
<div class="kpi-card">
|
| 494 |
+
<div class="kpi-title">Uncertainty (sigma)</div>
|
| 495 |
+
<div class="kpi-value" id="kpi_sigma">0.1936</div>
|
| 496 |
+
</div>
|
| 497 |
+
<div class="kpi-card">
|
| 498 |
+
<div class="kpi-title">LCB Score (lambda=1.0)</div>
|
| 499 |
+
<div class="kpi-value" id="kpi_lcb">0.5564</div>
|
| 500 |
+
</div>
|
| 501 |
+
<div class="kpi-card">
|
| 502 |
+
<div class="kpi-title">P(theta > threshold)</div>
|
| 503 |
+
<div class="kpi-value" id="kpi_prob">65.70%</div>
|
| 504 |
+
</div>
|
| 505 |
+
</div>
|
| 506 |
+
|
| 507 |
+
<div id="statusBanner" class="status-banner status-active">
|
| 508 |
+
<span>OPERATIONAL STATUS: ACTIVE (Admissible for Agent Memory Bank)</span>
|
| 509 |
+
<span class="cell-mono" id="statusDetail">P(theta > 0.70) = 65.70% >= 5.00%</span>
|
| 510 |
+
</div>
|
| 511 |
+
|
| 512 |
+
<div class="card">
|
| 513 |
+
<h3>Posterior Distribution & Uncertainty Quantification</h3>
|
| 514 |
+
<div id="betaPlot"></div>
|
| 515 |
+
</div>
|
| 516 |
+
|
| 517 |
+
<div class="card">
|
| 518 |
+
<h3>Theorem 1 Verification: Consecutive Failure Trajectory</h3>
|
| 519 |
+
<p style="font-size: 13px; color: var(--text-secondary); margin-bottom: 12px;">
|
| 520 |
+
Minimum consecutive failures to trigger deterministic quarantine:
|
| 521 |
+
t* = min { t in N : P(theta > 0.70 | 0, t) < 0.05 } = exactly 4 trials under weakly-informative prior Beta(3, 1).
|
| 522 |
+
</p>
|
| 523 |
+
<div class="table-container">
|
| 524 |
+
<table id="trajectoryTable">
|
| 525 |
+
<thead>
|
| 526 |
+
<tr>
|
| 527 |
+
<th>Consecutive Failures (t)</th>
|
| 528 |
+
<th>Posterior Distribution</th>
|
| 529 |
+
<th>Posterior Mean E[theta]</th>
|
| 530 |
+
<th>Epistemic Uncertainty (sigma)</th>
|
| 531 |
+
<th>P(theta > threshold)</th>
|
| 532 |
+
<th>Quarantine Status</th>
|
| 533 |
+
</tr>
|
| 534 |
+
</thead>
|
| 535 |
+
<tbody id="trajectoryTbody">
|
| 536 |
+
<!-- Populated dynamically -->
|
| 537 |
+
</tbody>
|
| 538 |
+
</table>
|
| 539 |
+
</div>
|
| 540 |
+
</div>
|
| 541 |
+
</div>
|
| 542 |
+
</div>
|
| 543 |
+
</div>
|
| 544 |
+
|
| 545 |
+
<!-- TAB 2 -->
|
| 546 |
+
<div id="tab2" class="tab-content">
|
| 547 |
+
<div class="card">
|
| 548 |
+
<h3>Pessimistic LCB Memory Retrieval vs Naive Vector Search</h3>
|
| 549 |
+
<p class="subtitle" style="margin-bottom: 16px;">
|
| 550 |
+
Simulates a real-world task query where an agent must select an episodic strategy.
|
| 551 |
+
Corrupted strategies repeatedly retrieve high semantic cosine similarity, causing cascading failures under naive RAG.
|
| 552 |
+
Our composite score: <strong>Score(e; q) = Sim(q, v_e) * LCB_lambda(e)</strong> suppresses corrupted memories and penalizes untested uncertainty.
|
| 553 |
+
</p>
|
| 554 |
+
|
| 555 |
+
<div class="formula-box">
|
| 556 |
+
Retrieval Composite Scoring:
|
| 557 |
+
Score(e; q) = Sim(q, v_e) * max(0.0, E[theta | n_s, n_f] - lambda * sqrt(Var[theta | n_s, n_f]))
|
| 558 |
+
</div>
|
| 559 |
+
|
| 560 |
+
<div class="control-group" style="max-width: 480px; margin-bottom: 24px;">
|
| 561 |
+
<div class="control-label">
|
| 562 |
+
<span>Risk Aversion Parameter (lambda)</span>
|
| 563 |
+
<span class="control-val" id="val_tab2_lam">1.0</span>
|
| 564 |
+
</div>
|
| 565 |
+
<input type="range" id="input_tab2_lam" min="0.0" max="3.0" step="0.25" value="1.0" oninput="updateTab2()">
|
| 566 |
+
</div>
|
| 567 |
+
|
| 568 |
+
<div class="table-container">
|
| 569 |
+
<table>
|
| 570 |
+
<thead>
|
| 571 |
+
<tr>
|
| 572 |
+
<th>LCB Rank</th>
|
| 573 |
+
<th>Memory ID</th>
|
| 574 |
+
<th>Domain</th>
|
| 575 |
+
<th>Semantic Cosine Sim</th>
|
| 576 |
+
<th>Successes (n_s)</th>
|
| 577 |
+
<th>Failures (n_f)</th>
|
| 578 |
+
<th>Posterior Mean</th>
|
| 579 |
+
<th>LCB Score</th>
|
| 580 |
+
<th>Naive Score (Sim)</th>
|
| 581 |
+
<th>Proposed Composite Score</th>
|
| 582 |
+
<th>Status</th>
|
| 583 |
+
<th>Operational Directive</th>
|
| 584 |
+
</tr>
|
| 585 |
+
</thead>
|
| 586 |
+
<tbody id="retrievalTbody">
|
| 587 |
+
<!-- Dynamically populated -->
|
| 588 |
+
</tbody>
|
| 589 |
+
</table>
|
| 590 |
+
</div>
|
| 591 |
+
|
| 592 |
+
<div style="margin-top: 20px; padding: 14px; background: rgba(59, 130, 246, 0.08); border: 1px solid rgba(59, 130, 246, 0.2); border-radius: 8px; font-size: 13px;">
|
| 593 |
+
<strong>Analytical Inspection:</strong>
|
| 594 |
+
<ul style="margin-left: 20px; margin-top: 6px;">
|
| 595 |
+
<li><strong>lambda = 0.0 (Naive Cosine):</strong> <code>MEM-CORRUPT-01</code> ranks #1 (score 0.940) despite 5 empirical failures. Agent succumbs to negative transfer.</li>
|
| 596 |
+
<li><strong>lambda >= 1.0 (Pessimistic LCB):</strong> <code>MEM-CORRUPT-01</code> is pruned or suppressed. <code>MEM-ROBUST-02</code> (22 successes, 1 failure) correctly assumes rank #1.</li>
|
| 597 |
+
<li><strong>MEM-UNTESTED-03:</strong> Has high semantic similarity (0.890) but zero execution history; its epistemic uncertainty penalty prevents naive over-reliance.</li>
|
| 598 |
+
</ul>
|
| 599 |
+
</div>
|
| 600 |
+
</div>
|
| 601 |
+
</div>
|
| 602 |
+
|
| 603 |
+
<!-- TAB 3 -->
|
| 604 |
+
<div id="tab3" class="tab-content">
|
| 605 |
+
<div class="card">
|
| 606 |
+
<h3>Empirical Benchmark Telemetry (1,200 Execution Steps)</h3>
|
| 607 |
+
<p class="subtitle">
|
| 608 |
+
Experimental comparison across 4 controlled conditions under an adversarial noise injection window (steps 60 to 140).
|
| 609 |
+
</p>
|
| 610 |
+
<div class="table-container">
|
| 611 |
+
<table>
|
| 612 |
+
<thead>
|
| 613 |
+
<tr>
|
| 614 |
+
<th>Ablation Condition</th>
|
| 615 |
+
<th>Total Steps</th>
|
| 616 |
+
<th>Task Accuracy</th>
|
| 617 |
+
<th>Average Reward</th>
|
| 618 |
+
<th>Mean Cosine Sim</th>
|
| 619 |
+
<th>Quarantine Triggers</th>
|
| 620 |
+
<th>Core Mechanism</th>
|
| 621 |
+
</tr>
|
| 622 |
+
</thead>
|
| 623 |
+
<tbody>
|
| 624 |
+
<tr>
|
| 625 |
+
<td><strong>Condition A: Vanilla Baseline</strong></td>
|
| 626 |
+
<td class="cell-mono">300</td>
|
| 627 |
+
<td class="cell-mono">48.33%</td>
|
| 628 |
+
<td class="cell-mono">0.483</td>
|
| 629 |
+
<td class="cell-mono">0.000</td>
|
| 630 |
+
<td class="cell-mono">0</td>
|
| 631 |
+
<td>Zero inter-task memory. Agent approaches each task tabula rasa.</td>
|
| 632 |
+
</tr>
|
| 633 |
+
<tr style="background: rgba(239, 68, 68, 0.08);">
|
| 634 |
+
<td><strong>Condition B: Naive Vector RAG</strong></td>
|
| 635 |
+
<td class="cell-mono">300</td>
|
| 636 |
+
<td class="cell-mono">32.67%</td>
|
| 637 |
+
<td class="cell-mono">0.327</td>
|
| 638 |
+
<td class="cell-mono">0.824</td>
|
| 639 |
+
<td class="cell-mono">0</td>
|
| 640 |
+
<td>Semantic cosine similarity retrieval. Collapses under memory poisoning.</td>
|
| 641 |
+
</tr>
|
| 642 |
+
<tr>
|
| 643 |
+
<td><strong>Condition C: Symmetric Reflexion</strong></td>
|
| 644 |
+
<td class="cell-mono">300</td>
|
| 645 |
+
<td class="cell-mono">61.25%</td>
|
| 646 |
+
<td class="cell-mono">0.613</td>
|
| 647 |
+
<td class="cell-mono">0.789</td>
|
| 648 |
+
<td class="cell-mono">0</td>
|
| 649 |
+
<td>Symmetric Exponential Moving Average (EMA). Lacks uncertainty bounds.</td>
|
| 650 |
+
</tr>
|
| 651 |
+
<tr style="background: rgba(16, 185, 129, 0.08); font-weight: 600;">
|
| 652 |
+
<td><strong>Condition D: Adaptive Bayesian LCB (Proposed)</strong></td>
|
| 653 |
+
<td class="cell-mono">300</td>
|
| 654 |
+
<td class="cell-mono">84.58%</td>
|
| 655 |
+
<td class="cell-mono">0.846</td>
|
| 656 |
+
<td class="cell-mono">0.742</td>
|
| 657 |
+
<td class="cell-mono">42</td>
|
| 658 |
+
<td>Conjugate Beta-Bernoulli, LCB composite retrieval, Theorem 1 quarantine. (+51.91% over naive RAG).</td>
|
| 659 |
+
</tr>
|
| 660 |
+
</tbody>
|
| 661 |
+
</table>
|
| 662 |
+
</div>
|
| 663 |
+
</div>
|
| 664 |
+
|
| 665 |
+
<div class="card">
|
| 666 |
+
<h3>Academic Citation & Reproducibility</h3>
|
| 667 |
+
<p style="font-size: 13px; color: var(--text-secondary); margin-bottom: 12px;">
|
| 668 |
+
Use the following BibTeX entry to cite this benchmark and methodology in research:
|
| 669 |
+
</p>
|
| 670 |
+
<div class="formula-box" id="bibtexText">@article{das2026adaptive,
|
| 671 |
+
title={Adaptive Agent Memory Resilience: Mitigating Negative Transfer and Memory Poisoning via Bayesian Trust Updating and Pessimistic Lower Confidence Bound Retrieval},
|
| 672 |
+
author={Das, Sumit},
|
| 673 |
+
journal={arXiv preprint},
|
| 674 |
+
year={2026}
|
| 675 |
+
}</div>
|
| 676 |
+
<button class="btn btn-secondary" onclick="copyBibtex()">Copy BibTeX</button>
|
| 677 |
+
</div>
|
| 678 |
+
</div>
|
| 679 |
+
|
| 680 |
+
<footer>
|
| 681 |
+
Adaptive Agent Memory Resilience Benchmark © 2026 Sumit Das. All rights reserved. Built for Hugging Face Spaces.
|
| 682 |
+
</footer>
|
| 683 |
+
</div>
|
| 684 |
+
|
| 685 |
+
<script>
|
| 686 |
+
// --- Mathematical Engine (Accurate Lanczos & Continued Fraction Incomplete Beta) ---
|
| 687 |
+
|
| 688 |
+
function logGamma(z) {
|
| 689 |
+
const p = [
|
| 690 |
+
676.5203681218851, -1259.1392167224028, 771.32342877765313,
|
| 691 |
+
-176.61502916214059, 12.507343278686905, -0.13857109583654525,
|
| 692 |
+
9.9843695780195716e-6, 1.5056327351493116e-7
|
| 693 |
+
];
|
| 694 |
+
if (z < 0.5) {
|
| 695 |
+
return Math.log(Math.PI / Math.sin(Math.PI * z)) - logGamma(1 - z);
|
| 696 |
+
}
|
| 697 |
+
z -= 1;
|
| 698 |
+
let x = 0.99999999999980993;
|
| 699 |
+
for (let i = 0; i < p.length; i++) {
|
| 700 |
+
x += p[i] / (z + i + 1);
|
| 701 |
+
}
|
| 702 |
+
let t = z + p.length - 0.5;
|
| 703 |
+
return 0.5 * Math.log(2 * Math.PI) + (z + 0.5) * Math.log(t) - t + Math.log(x);
|
| 704 |
+
}
|
| 705 |
+
|
| 706 |
+
function betaCf(a, b, x, maxIter = 100, eps = 1e-12) {
|
| 707 |
+
const qab = a + b;
|
| 708 |
+
const qap = a + 1.0;
|
| 709 |
+
const qam = a - 1.0;
|
| 710 |
+
let c = 1.0;
|
| 711 |
+
let d = 1.0 - qab * x / qap;
|
| 712 |
+
if (Math.abs(d) < 1e-30) d = 1e-30;
|
| 713 |
+
d = 1.0 / d;
|
| 714 |
+
let h = d;
|
| 715 |
+
for (let m = 1; m <= maxIter; m++) {
|
| 716 |
+
let m2 = 2 * m;
|
| 717 |
+
// Even step
|
| 718 |
+
let aa = m * (b - m) * x / ((qam + m2) * (a + m2));
|
| 719 |
+
d = 1.0 + aa * d;
|
| 720 |
+
if (Math.abs(d) < 1e-30) d = 1e-30;
|
| 721 |
+
c = 1.0 + aa / c;
|
| 722 |
+
if (Math.abs(c) < 1e-30) c = 1e-30;
|
| 723 |
+
d = 1.0 / d;
|
| 724 |
+
h *= d * c;
|
| 725 |
+
// Odd step
|
| 726 |
+
aa = -(a + m) * (qab + m) * x / ((a + m2) * (qap + m2));
|
| 727 |
+
d = 1.0 + aa * d;
|
| 728 |
+
if (Math.abs(d) < 1e-30) d = 1e-30;
|
| 729 |
+
c = 1.0 + aa / c;
|
| 730 |
+
if (Math.abs(c) < 1e-30) c = 1e-30;
|
| 731 |
+
d = 1.0 / d;
|
| 732 |
+
let del = d * c;
|
| 733 |
+
h *= del;
|
| 734 |
+
if (Math.abs(del - 1.0) < eps) break;
|
| 735 |
+
}
|
| 736 |
+
return h;
|
| 737 |
+
}
|
| 738 |
+
|
| 739 |
+
function regularizedBetainc(a, b, x) {
|
| 740 |
+
if (x <= 0.0) return 0.0;
|
| 741 |
+
if (x >= 1.0) return 1.0;
|
| 742 |
+
let bt = Math.exp(logGamma(a + b) - logGamma(a) - logGamma(b) + a * Math.log(x) + b * Math.log(1.0 - x));
|
| 743 |
+
if (x < (a + 1.0) / (a + b + 2.0)) {
|
| 744 |
+
return bt * betaCf(a, b, x) / a;
|
| 745 |
+
} else {
|
| 746 |
+
return 1.0 - bt * betaCf(b, a, 1.0 - x) / b;
|
| 747 |
+
}
|
| 748 |
+
}
|
| 749 |
+
|
| 750 |
+
function betaPdf(x, a, b) {
|
| 751 |
+
if (x <= 0.0 || x >= 1.0) return 0.0;
|
| 752 |
+
let lnorm = logGamma(a + b) - logGamma(a) - logGamma(b);
|
| 753 |
+
let logVal = lnorm + (a - 1.0) * Math.log(x) + (b - 1.0) * Math.log(1.0 - x);
|
| 754 |
+
return Math.exp(logVal);
|
| 755 |
+
}
|
| 756 |
+
|
| 757 |
+
function betaTrustMean(ns, nf, a0 = 3.0, b0 = 1.0) {
|
| 758 |
+
let a = a0 + ns;
|
| 759 |
+
let b = b0 + nf;
|
| 760 |
+
return a / (a + b);
|
| 761 |
+
}
|
| 762 |
+
|
| 763 |
+
function betaTrustVar(ns, nf, a0 = 3.0, b0 = 1.0) {
|
| 764 |
+
let a = a0 + ns;
|
| 765 |
+
let b = b0 + nf;
|
| 766 |
+
let total = a + b;
|
| 767 |
+
return (a * b) / (Math.pow(total, 2) * (total + 1.0));
|
| 768 |
+
}
|
| 769 |
+
|
| 770 |
+
function betaTrustStd(ns, nf, a0 = 3.0, b0 = 1.0) {
|
| 771 |
+
return Math.sqrt(betaTrustVar(ns, nf, a0, b0));
|
| 772 |
+
}
|
| 773 |
+
|
| 774 |
+
function betaLcb(ns, nf, lam = 1.0, a0 = 3.0, b0 = 1.0) {
|
| 775 |
+
let mu = betaTrustMean(ns, nf, a0, b0);
|
| 776 |
+
let std = betaTrustStd(ns, nf, a0, b0);
|
| 777 |
+
return Math.max(0.0, Math.min(1.0, mu - lam * std));
|
| 778 |
+
}
|
| 779 |
+
|
| 780 |
+
function posteriorProbReliable(ns, nf, threshold = 0.70, a0 = 3.0, b0 = 1.0) {
|
| 781 |
+
let a = a0 + ns;
|
| 782 |
+
let b = b0 + nf;
|
| 783 |
+
let cdf = regularizedBetainc(a, b, threshold);
|
| 784 |
+
return Math.max(0.0, Math.min(1.0, 1.0 - cdf));
|
| 785 |
+
}
|
| 786 |
+
|
| 787 |
+
function shouldQuarantine(ns, nf, gamma = 0.05, threshold = 0.70, a0 = 3.0, b0 = 1.0) {
|
| 788 |
+
return posteriorProbReliable(ns, nf, threshold, a0, b0) < gamma;
|
| 789 |
+
}
|
| 790 |
+
|
| 791 |
+
// --- Tab Switching ---
|
| 792 |
+
function switchTab(tabId, el) {
|
| 793 |
+
document.querySelectorAll('.tab-content').forEach(c => c.classList.remove('active'));
|
| 794 |
+
document.querySelectorAll('.tab-btn').forEach(b => b.classList.remove('active'));
|
| 795 |
+
document.getElementById(tabId).classList.add('active');
|
| 796 |
+
el.classList.add('active');
|
| 797 |
+
if (tabId === 'tab1') {
|
| 798 |
+
Plotly.relayout('betaPlot', {});
|
| 799 |
+
}
|
| 800 |
+
}
|
| 801 |
+
|
| 802 |
+
// --- Tab 1 Dynamic Updates ---
|
| 803 |
+
function updateState() {
|
| 804 |
+
let a0 = parseFloat(document.getElementById('input_a0').value);
|
| 805 |
+
let b0 = parseFloat(document.getElementById('input_b0').value);
|
| 806 |
+
let ns = parseInt(document.getElementById('input_ns').value);
|
| 807 |
+
let nf = parseInt(document.getElementById('input_nf').value);
|
| 808 |
+
let lam = parseFloat(document.getElementById('input_lam').value);
|
| 809 |
+
let thresh = parseFloat(document.getElementById('input_thresh').value);
|
| 810 |
+
let gam = parseFloat(document.getElementById('input_gamma').value);
|
| 811 |
+
|
| 812 |
+
document.getElementById('val_a0').textContent = a0.toFixed(1);
|
| 813 |
+
document.getElementById('val_b0').textContent = b0.toFixed(1);
|
| 814 |
+
document.getElementById('val_ns').textContent = ns;
|
| 815 |
+
document.getElementById('val_nf').textContent = nf;
|
| 816 |
+
document.getElementById('val_lam').textContent = lam.toFixed(1);
|
| 817 |
+
document.getElementById('val_thresh').textContent = thresh.toFixed(2);
|
| 818 |
+
document.getElementById('val_gamma').textContent = gam.toFixed(2);
|
| 819 |
+
|
| 820 |
+
let mu = betaTrustMean(ns, nf, a0, b0);
|
| 821 |
+
let std = betaTrustStd(ns, nf, a0, b0);
|
| 822 |
+
let lcb = betaLcb(ns, nf, lam, a0, b0);
|
| 823 |
+
let pRel = posteriorProbReliable(ns, nf, thresh, a0, b0);
|
| 824 |
+
let isQuarantined = pRel < gam;
|
| 825 |
+
|
| 826 |
+
document.getElementById('kpi_mean').textContent = mu.toFixed(4);
|
| 827 |
+
document.getElementById('kpi_sigma').textContent = std.toFixed(4);
|
| 828 |
+
document.getElementById('kpi_lcb').textContent = lcb.toFixed(4);
|
| 829 |
+
document.getElementById('kpi_prob').textContent = (pRel * 100).toFixed(2) + '%';
|
| 830 |
+
|
| 831 |
+
let banner = document.getElementById('statusBanner');
|
| 832 |
+
let bannerDetail = document.getElementById('statusDetail');
|
| 833 |
+
if (isQuarantined) {
|
| 834 |
+
banner.className = 'status-banner status-quarantined';
|
| 835 |
+
banner.firstElementChild.textContent = 'OPERATIONAL STATUS: QUARANTINED (Pruned from Retrieval)';
|
| 836 |
+
bannerDetail.textContent = `P(theta > ${thresh.toFixed(2)}) = ${(pRel * 100).toFixed(2)}% < ${(gam * 100).toFixed(2)}% (Significance Threshold)`;
|
| 837 |
+
} else {
|
| 838 |
+
banner.className = 'status-banner status-active';
|
| 839 |
+
banner.firstElementChild.textContent = 'OPERATIONAL STATUS: ACTIVE (Admissible for Agent Memory Bank)';
|
| 840 |
+
bannerDetail.textContent = `P(theta > ${thresh.toFixed(2)}) = ${(pRel * 100).toFixed(2)}% >= ${(gam * 100).toFixed(2)}%`;
|
| 841 |
+
}
|
| 842 |
+
|
| 843 |
+
renderPlot(a0, b0, ns, nf, lam, thresh, pRel);
|
| 844 |
+
renderTrajectoryTable(a0, b0, thresh, gam);
|
| 845 |
+
}
|
| 846 |
+
|
| 847 |
+
function renderPlot(a0, b0, ns, nf, lam, thresh, pRel) {
|
| 848 |
+
let aPost = a0 + ns;
|
| 849 |
+
let bPost = b0 + nf;
|
| 850 |
+
let mu = betaTrustMean(ns, nf, a0, b0);
|
| 851 |
+
let lcb = betaLcb(ns, nf, lam, a0, b0);
|
| 852 |
+
|
| 853 |
+
let numPoints = 300;
|
| 854 |
+
let x = [];
|
| 855 |
+
let yPost = [];
|
| 856 |
+
let yPrior = [];
|
| 857 |
+
let xRel = [];
|
| 858 |
+
let yRel = [];
|
| 859 |
+
|
| 860 |
+
for (let i = 0; i < numPoints; i++) {
|
| 861 |
+
let val = 0.002 + (i / (numPoints - 1)) * 0.996;
|
| 862 |
+
x.push(val);
|
| 863 |
+
let yp = betaPdf(val, aPost, bPost);
|
| 864 |
+
let ypr = betaPdf(val, a0, b0);
|
| 865 |
+
yPost.push(yp);
|
| 866 |
+
yPrior.push(ypr);
|
| 867 |
+
if (val >= thresh) {
|
| 868 |
+
xRel.push(val);
|
| 869 |
+
yRel.push(yp);
|
| 870 |
+
}
|
| 871 |
+
}
|
| 872 |
+
|
| 873 |
+
let traces = [
|
| 874 |
+
{
|
| 875 |
+
x: x,
|
| 876 |
+
y: yPrior,
|
| 877 |
+
mode: 'lines',
|
| 878 |
+
name: `Prior Beta(${a0.toFixed(1)}, ${b0.toFixed(1)})`,
|
| 879 |
+
line: { color: 'rgba(148, 163, 184, 0.5)', width: 1.5, dash: 'dash' }
|
| 880 |
+
},
|
| 881 |
+
{
|
| 882 |
+
x: x,
|
| 883 |
+
y: yPost,
|
| 884 |
+
mode: 'lines',
|
| 885 |
+
name: `Posterior Beta(${aPost.toFixed(1)}, ${bPost.toFixed(1)})`,
|
| 886 |
+
line: { color: '#3b82f6', width: 3 }
|
| 887 |
+
}
|
| 888 |
+
];
|
| 889 |
+
|
| 890 |
+
if (xRel.length > 0) {
|
| 891 |
+
traces.push({
|
| 892 |
+
x: [thresh, ...xRel, xRel[xRel.length - 1]],
|
| 893 |
+
y: [0, ...yRel, 0],
|
| 894 |
+
fill: 'toself',
|
| 895 |
+
fillcolor: 'rgba(16, 185, 129, 0.22)',
|
| 896 |
+
line: { color: 'transparent' },
|
| 897 |
+
name: `Admissible Region (P=${(pRel * 100).toFixed(1)}%)`,
|
| 898 |
+
hoverinfo: 'skip'
|
| 899 |
+
});
|
| 900 |
+
}
|
| 901 |
+
|
| 902 |
+
let layout = {
|
| 903 |
+
title: {
|
| 904 |
+
text: `Posterior Reliability Curve vs Prior Distribution`,
|
| 905 |
+
font: { color: '#f8fafc', size: 14 }
|
| 906 |
+
},
|
| 907 |
+
paper_bgcolor: '#1e293b',
|
| 908 |
+
plot_bgcolor: '#1e293b',
|
| 909 |
+
xaxis: {
|
| 910 |
+
title: { text: 'True Latent Reliability theta in [0, 1]', font: { color: '#94a3b8' } },
|
| 911 |
+
range: [0.0, 1.0],
|
| 912 |
+
gridcolor: '#334155',
|
| 913 |
+
tickfont: { color: '#94a3b8' }
|
| 914 |
+
},
|
| 915 |
+
yaxis: {
|
| 916 |
+
title: { text: 'Probability Density f(theta)', font: { color: '#94a3b8' } },
|
| 917 |
+
gridcolor: '#334155',
|
| 918 |
+
tickfont: { color: '#94a3b8' }
|
| 919 |
+
},
|
| 920 |
+
legend: {
|
| 921 |
+
orientation: 'h',
|
| 922 |
+
y: 1.12,
|
| 923 |
+
x: 1.0,
|
| 924 |
+
xanchor: 'right',
|
| 925 |
+
font: { color: '#94a3b8' }
|
| 926 |
+
},
|
| 927 |
+
margin: { l: 45, r: 25, t: 40, b: 40 },
|
| 928 |
+
shapes: [
|
| 929 |
+
{
|
| 930 |
+
type: 'line',
|
| 931 |
+
x0: thresh, x1: thresh, y0: 0, y1: 1, yref: 'paper',
|
| 932 |
+
line: { color: '#ef4444', width: 2, dash: 'dash' }
|
| 933 |
+
},
|
| 934 |
+
{
|
| 935 |
+
type: 'line',
|
| 936 |
+
x0: mu, x1: mu, y0: 0, y1: 1, yref: 'paper',
|
| 937 |
+
line: { color: '#3b82f6', width: 2 }
|
| 938 |
+
},
|
| 939 |
+
{
|
| 940 |
+
type: 'line',
|
| 941 |
+
x0: lcb, x1: lcb, y0: 0, y1: 1, yref: 'paper',
|
| 942 |
+
line: { color: '#8b5cf6', width: 2, dash: 'dot' }
|
| 943 |
+
}
|
| 944 |
+
],
|
| 945 |
+
annotations: [
|
| 946 |
+
{
|
| 947 |
+
x: thresh, y: 0.95, yref: 'paper',
|
| 948 |
+
text: `Threshold (${thresh.toFixed(2)})`,
|
| 949 |
+
showarrow: false, font: { color: '#ef4444', size: 11 }, xanchor: 'right'
|
| 950 |
+
},
|
| 951 |
+
{
|
| 952 |
+
x: mu, y: 0.85, yref: 'paper',
|
| 953 |
+
text: `Mean (${mu.toFixed(2)})`,
|
| 954 |
+
showarrow: false, font: { color: '#3b82f6', size: 11 }, xanchor: 'left'
|
| 955 |
+
},
|
| 956 |
+
{
|
| 957 |
+
x: lcb, y: 0.15, yref: 'paper',
|
| 958 |
+
text: `LCB (${lcb.toFixed(2)})`,
|
| 959 |
+
showarrow: false, font: { color: '#8b5cf6', size: 11 }, xanchor: 'right'
|
| 960 |
+
}
|
| 961 |
+
]
|
| 962 |
+
};
|
| 963 |
+
|
| 964 |
+
Plotly.react('betaPlot', traces, layout, { responsive: true, displayModeBar: false });
|
| 965 |
+
}
|
| 966 |
+
|
| 967 |
+
function renderTrajectoryTable(a0, b0, thresh, gam) {
|
| 968 |
+
let tbody = document.getElementById('trajectoryTbody');
|
| 969 |
+
tbody.innerHTML = '';
|
| 970 |
+
for (let t = 0; t <= 6; t++) {
|
| 971 |
+
let mu = a0 / (a0 + b0 + t);
|
| 972 |
+
let std = Math.sqrt((a0 * (b0 + t)) / (Math.pow(a0 + b0 + t, 2) * (a0 + b0 + t + 1)));
|
| 973 |
+
let pRel = posteriorProbReliable(0, t, thresh, a0, b0);
|
| 974 |
+
let isQ = pRel < gam;
|
| 975 |
+
|
| 976 |
+
let tr = document.createElement('tr');
|
| 977 |
+
if (isQ) tr.style.background = 'rgba(239, 68, 68, 0.08)';
|
| 978 |
+
|
| 979 |
+
tr.innerHTML = `
|
| 980 |
+
<td class="cell-mono">${t}</td>
|
| 981 |
+
<td class="cell-mono">Beta(${a0.toFixed(1)}, ${(b0 + t).toFixed(1)})</td>
|
| 982 |
+
<td class="cell-mono">${mu.toFixed(4)}</td>
|
| 983 |
+
<td class="cell-mono">${std.toFixed(4)}</td>
|
| 984 |
+
<td class="cell-mono">${(pRel * 100).toFixed(2)}%</td>
|
| 985 |
+
<td>
|
| 986 |
+
<span class="tag-q ${isQ ? 'tag-quarantine' : 'tag-active'}">
|
| 987 |
+
${isQ ? 'QUARANTINED (t* threshold)' : 'ACTIVE'}
|
| 988 |
+
</span>
|
| 989 |
+
</td>
|
| 990 |
+
`;
|
| 991 |
+
tbody.appendChild(tr);
|
| 992 |
+
}
|
| 993 |
+
}
|
| 994 |
+
|
| 995 |
+
// --- Tab 2: Retrieval Ranking ---
|
| 996 |
+
const CANDIDATE_MEMORIES = [
|
| 997 |
+
{
|
| 998 |
+
id: "MEM-CORRUPT-01",
|
| 999 |
+
domain: "coding",
|
| 1000 |
+
lesson: "Use global shared state across async workers without mutex lock for throughput.",
|
| 1001 |
+
sim: 0.940,
|
| 1002 |
+
ns: 2,
|
| 1003 |
+
nf: 5,
|
| 1004 |
+
note: "Corrupted/stale reflection causing race condition deadlocks."
|
| 1005 |
+
},
|
| 1006 |
+
{
|
| 1007 |
+
id: "MEM-ROBUST-02",
|
| 1008 |
+
domain: "coding",
|
| 1009 |
+
lesson: "Implement asyncio.Lock with timeout fallback and circuit breaker isolation.",
|
| 1010 |
+
sim: 0.830,
|
| 1011 |
+
ns: 22,
|
| 1012 |
+
nf: 1,
|
| 1013 |
+
note: "High empirical validation under stress tests."
|
| 1014 |
+
},
|
| 1015 |
+
{
|
| 1016 |
+
id: "MEM-UNTESTED-03",
|
| 1017 |
+
domain: "coding",
|
| 1018 |
+
lesson: "Refactor threading pool to use separate child process queues.",
|
| 1019 |
+
sim: 0.890,
|
| 1020 |
+
ns: 0,
|
| 1021 |
+
nf: 0,
|
| 1022 |
+
note: "Newly distilled reflection with zero empirical execution history."
|
| 1023 |
+
},
|
| 1024 |
+
{
|
| 1025 |
+
id: "MEM-MARGINAL-04",
|
| 1026 |
+
domain: "coding",
|
| 1027 |
+
lesson: "Log execution traceback to local scratch buffer before propagating exceptions.",
|
| 1028 |
+
sim: 0.650,
|
| 1029 |
+
ns: 15,
|
| 1030 |
+
nf: 2,
|
| 1031 |
+
note: "Low direct task relevance, but high historical reliability."
|
| 1032 |
+
}
|
| 1033 |
+
];
|
| 1034 |
+
|
| 1035 |
+
function updateTab2() {
|
| 1036 |
+
let lam = parseFloat(document.getElementById('input_tab2_lam').value);
|
| 1037 |
+
document.getElementById('val_tab2_lam').textContent = lam.toFixed(2);
|
| 1038 |
+
|
| 1039 |
+
let scored = CANDIDATE_MEMORIES.map(m => {
|
| 1040 |
+
let mu = betaTrustMean(m.ns, m.nf, 3.0, 1.0);
|
| 1041 |
+
let std = betaTrustStd(m.ns, m.nf, 3.0, 1.0);
|
| 1042 |
+
let lcb = betaLcb(m.ns, m.nf, lam, 3.0, 1.0);
|
| 1043 |
+
let isQ = shouldQuarantine(m.ns, m.nf, 0.05, 0.70, 3.0, 1.0);
|
| 1044 |
+
let naiveScore = m.sim;
|
| 1045 |
+
let composite = isQ ? 0.0 : m.sim * lcb;
|
| 1046 |
+
return {
|
| 1047 |
+
...m,
|
| 1048 |
+
mu, std, lcb, isQ, naiveScore, composite
|
| 1049 |
+
};
|
| 1050 |
+
});
|
| 1051 |
+
|
| 1052 |
+
scored.sort((a, b) => b.composite - a.composite);
|
| 1053 |
+
|
| 1054 |
+
let tbody = document.getElementById('retrievalTbody');
|
| 1055 |
+
tbody.innerHTML = '';
|
| 1056 |
+
scored.forEach((m, idx) => {
|
| 1057 |
+
let tr = document.createElement('tr');
|
| 1058 |
+
if (m.isQ) tr.style.background = 'rgba(239, 68, 68, 0.08)';
|
| 1059 |
+
tr.innerHTML = `
|
| 1060 |
+
<td class="cell-mono">#${idx + 1}</td>
|
| 1061 |
+
<td class="cell-mono">${m.id}</td>
|
| 1062 |
+
<td>${m.domain}</td>
|
| 1063 |
+
<td class="cell-mono">${m.sim.toFixed(3)}</td>
|
| 1064 |
+
<td class="cell-mono">${m.ns}</td>
|
| 1065 |
+
<td class="cell-mono">${m.nf}</td>
|
| 1066 |
+
<td class="cell-mono">${m.mu.toFixed(3)}</td>
|
| 1067 |
+
<td class="cell-mono">${m.lcb.toFixed(3)}</td>
|
| 1068 |
+
<td class="cell-mono">${m.naiveScore.toFixed(3)}</td>
|
| 1069 |
+
<td class="cell-mono" style="font-weight: 700; color: ${m.composite > 0.5 ? '#34d399' : '#f87171'};">
|
| 1070 |
+
${m.composite.toFixed(3)}
|
| 1071 |
+
</td>
|
| 1072 |
+
<td>
|
| 1073 |
+
<span class="tag-q ${m.isQ ? 'tag-quarantine' : 'tag-active'}">
|
| 1074 |
+
${m.isQ ? 'QUARANTINED' : 'ACTIVE'}
|
| 1075 |
+
</span>
|
| 1076 |
+
</td>
|
| 1077 |
+
<td style="font-size: 12px; color: var(--text-secondary); max-width: 280px;">${m.lesson}</td>
|
| 1078 |
+
`;
|
| 1079 |
+
tbody.appendChild(tr);
|
| 1080 |
+
});
|
| 1081 |
+
}
|
| 1082 |
+
|
| 1083 |
+
function copyBibtex() {
|
| 1084 |
+
let text = document.getElementById('bibtexText').textContent;
|
| 1085 |
+
navigator.clipboard.writeText(text).then(() => {
|
| 1086 |
+
alert('BibTeX citation copied to clipboard.');
|
| 1087 |
+
});
|
| 1088 |
+
}
|
| 1089 |
+
|
| 1090 |
+
// Initialize on load
|
| 1091 |
+
window.addEventListener('DOMContentLoaded', () => {
|
| 1092 |
+
updateState();
|
| 1093 |
+
updateTab2();
|
| 1094 |
+
});
|
| 1095 |
+
</script>
|
| 1096 |
+
</body>
|
| 1097 |
</html>
|
requirements.txt
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
gradio>=5.20.0
|
| 2 |
+
numpy>=1.24.0
|
| 3 |
+
scipy>=1.10.0
|
| 4 |
+
plotly>=5.18.0
|
| 5 |
+
pandas>=2.0.0
|