ai-tutor-chatbot / data /scraping_scripts

Commit History

Replace llama-index with a local Document dataclass
a190140

omarsol Claude Fable 5 commited on

Archive private KB bundles for fast cold starts
c8c398a

omarsol commited on

Fix stale claims across repo docs
a213ef5

omarsol Claude Fable 5 commited on

Improve KB command ergonomics, tool-output streaming, and wiki linting
766df7d

omarsol Claude Fable 5 commited on

docs: staleness sweep for core and pipeline docs
cfe30c3

omarsol Claude Fable 5 commited on

fix(retrieval): store the BM25 index as gzipped JSON instead of pickle (#13)
e0d6ca8
unverified

Omar Solano Claude Fable 5 commited on

chore(versions): capture 2026-07-06 docs refresh, purge retired openai_cookbooks
0000d72

omarsol Claude Fable 5 commited on

fix(versions): llms.txt sources get version=null, not a Last-Modified date
ba10d73

omarsol Claude Fable 5 commited on

fix(pipeline): single-source runs rebuild all_sources_data.jsonl safely
e2495b1

omarsol Claude Fable 5 commited on

fix(pipeline): make upload_data_to_hf report failure honestly
6e00dd6

omarsol Claude Fable 5 commited on

fix(registry): retire sources from every registry dict, not just the first
ef548e7

omarsol Claude Fable 5 commited on

fix(public-bundle): fail closed on non-allowlisted raw and wiki content
b4e1aa4

omarsol Claude Fable 5 commited on

fix(pipeline): re-embed chunks whose content changed in place
0cf9ad3

omarsol Claude Fable 5 commited on

fix(pipeline): stop incremental context runs gutting updated sources
82b28e5

omarsol Claude Fable 5 commited on

Public docs-only bundle: allowlist filtering, leak audit, kb.tar.gz cold start (#11)
7e5f705
unverified

Omar Solano Claude Fable 5 commited on

wip: eval harness + public docs bundle; relocate eval docs into evals/ (#10)
dc474cb
unverified

Omar Solano Claude Opus 4.8 (1M context) commited on

feat(registry): rename agentic_ai_engineering label to "Agent Engineering: Building Multi-Agent Systems"
9caada6

omarsol Claude Opus 4.8 (1M context) commited on

feat(kb): register guardrails and serving topic pages in wiki scaffolder
3fe6d27

omarsol Claude Opus 4.8 (1M context) commited on

Add 10-Hour LLM Primer course as a new KB source
3ecae23

Louis-François Bouchard Claude Opus 4.8 commited on

compaction study: harness for compaction-vs-keep-everything on a long lesson
0ad2e61

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

graphrag: publish the index to HF for reproducibility (prod cold-start skips it)
814e43b

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

graphrag: route Gemini 2.5 via OpenAI-compat endpoint; add index retry wrapper
4b82527

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

graphrag: validate retriever vs real index, fix bugs, scope by source
824b2e8

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

graphrag: scaffold true GraphRAG retriever arm (opt-in, default unchanged)
d498287

Louis-François Bouchard Claude Opus 4.8 (1M context) commited on

Add evaluation harness for memory/context-management experiments
a04f9ea

omarsol Claude Fable 5 commited on

Enhance knowledge base and API functionality
f2e8e50

omarsol commited on

Refactor project structure and update dependencies
d879dad

omarsol commited on

Renamed 'scripts' folder to 'app', removed mongo and instructor libraries
bd180ae

omarsol commited on

Update project structure
d5ed5c9

omarsol commited on

ruff format
3f613d2

omarsol commited on

Refactor update_kb_wiki to remove --changed-only option
925437c

omarsol commited on

Remove .md extension from url from llms.txt sources
7673b0b

omarsol commited on

Revise kb tool prompt
e100449

omarsol commited on

shorter comments
14290c1

omarsol commited on

add knowledge base wiki exploration tool
e73e01f

omarsol commited on

Refactor scraping scripts to enhance source management and contextual node processing. Introduce new helper functions for pruning inactive contextual nodes and managing llms.txt sources. Update existing scripts to utilize the new source registry for improved source handling and streamline the process of adding and updating courses. Enhance error handling and logging for better traceability during data processing.
7478ade

omarsol commited on

Remove "8 Hour Primer" references from scraping scripts and documentation, and introduce a new workflow for retiring sources from the data pipeline. Remove 8 Hour Primer from vector DB
ca3fec9

omarsol commited on

Add source version capturing script and integrate it into the documentation update workflow. Enhance API to load source versions for frontend display, ensuring the latest release tags and commit SHAs are recorded for each source.
6cb83c3

omarsol commited on

Update Full Stack and python courses
3bffa2f

omarsol commited on

Add Agentic AI Engineering course
c90757d

omarsol commited on

Modernize RAG indexing, streaming chat, and data workflows
a620b08

omarsol commited on

fix creation of embeddings
05f6255

omarsol commited on

Update docs/readme files
f46a350

omarsol commited on

Update README
c1efa6d

omarsol commited on

Update README for scraping scripts
0933e3e

omarsol commited on

add course workflow and update data to hf scripts
0b1b256

omarsol commited on

add update docs workflow
4ecfe75

omarsol commited on

Add comprehensive README for data scraping and workflow scripts
a54e637

omarsol commited on

Enhance combine_all_sources function with robust source processing and logging
75ceb60

omarsol commited on

Add Python Primer source configuration to markdown processing script
292e4e7

omarsol commited on