ai-tutor-chatbot / evals.md

Commit History

docs(evals): F38 numeric refinements from the repricing verification writeup
fb2d653

omarsol Claude Fable 5 commited on

docs(evals): findings F35-F38, battery v2 confound corrections, staleness fixes
5bb4725

omarsol Claude Fable 5 commited on

wip: eval harness + public docs bundle; relocate eval docs into evals/ (#10)
dc474cb
unverified

Omar Solano Claude Opus 4.8 (1M context) commited on

Merge experiment #3: SLM knowledge compaction (Ollama small models, 32k window)
6145817

omarsol Claude Opus 4.8 (1M context) commited on

docs: add evals_contributing.md — teammate experiment playbook
5916bd5

omarsol Claude Opus 4.8 (1M context) commited on

docs(evals): F29 — context-compaction maps a boundary where full_history stops winning
240a5c5

omarsol Claude Opus 4.8 (1M context) commited on

Merge experiment #5: context-compaction study (keep-all vs compaction vs retrieve, Gemini 2.5 Flash)
1ab0db9

omarsol Claude Opus 4.8 (1M context) commited on

docs(evals): promote GraphRAG result to F28 in the central findings log
37dd9db

omarsol Claude Opus 4.8 (1M context) commited on

Merge experiment #2: GraphRAG vs classical RAG (opt-in retriever + scoped comparison)
b596739

omarsol Claude Opus 4.8 (1M context) commited on

feat(evals): single-turn latency finding (F27) + de-confound latency tooling
c3ce548
unverified

Omar Solano Claude Opus 4.8 (1M context) commited on

evals(slm): Axis-A results (3 SLMs x 8 memory presets) + F25, dual-experiment writeup
15db620

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

evals: SLM knowledge-compaction findings (F24) + writeup
964f9d6

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

compaction study: standalone 2.5-Flash results writeup + report glob fix
8236846

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

feat: add findings on DeepSeek-V4-Flash performance and memory strategies
5a8e4b0

omarsol commited on

Refactor telemetry pricing and evaluation reports
e7f812d

omarsol commited on

graphrag: document the GraphRAG-vs-RAG experiment (methodology, build, run)
01dc73b

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

evals: add KB-fair recall/citation metrics; record F23
8c1213b

omarsol Claude Opus 4.8 (1M context) commited on

Refine v2 eval plan and memory harness
76c99a5

omarsol commited on

Make collaborator data-download snippet copy-paste-safe
494ca85

omarsol Claude Opus 4.8 (1M context) commited on

Add Part C eval variants, LLM judge, and harness fixes
c344089

omarsol Claude Opus 4.8 (1M context) commited on

Add evaluation harness for memory/context-management experiments
a04f9ea

omarsol Claude Fable 5 commited on