Agentic 0,07 B LM tasks + complete list of use-cases for Vintage LMs
Databases for various use-cased of Vintage LMs needed. Maybe they exist in a Discord community or in some brainstorms of reviewers, in some blogs here and there. Collection into a compete list needed.
I can imagine the task of inference of 20 century physics with a contamination-free 19-century LM. But I am not informed about any agentic frameworks for this task or similar tasks. How authentic pre-1900 agents shoold work - not clear too. Brobably based on pre-1900 patents and programming in Ada style. The number of paremeters for a programming formal language must be smaller than for multi-lang coding LLMs based on the Stack corpus.
I think all vintage LLMs are very far from that usecase, right now the best vintage LLM TypeWriter can barely follow instructions. I mean, it's not bad, but compared to other modern LLMs with 7B params it's not there.
Also the vintage LLMs don't know any programming, don't know any tool calls, they don't even know JSON or XML.
We are very far from agentic LLM for now.
I have a list of vintage LLMs here: https://crlf.link/log/entries/260428-1/
I have to add the new one: https://www.unboundedlab.com/blog/bartholomew
That's all the English vintage LLMs that I know of
vintage LLMs don't know any programming, don't know any tool calls, they don't even know JSON or XML.
Syntactic JSON/XML knowlege or concepts of programming? They probably can program in a natural language programming paradigm, popularized by Andrej K. https://en.wikipedia.org/wiki/Vibe_coding
so the question about authentic vintage agentic frameworks. Defenition of it as a minimum.
"forget that the code even exists" - verbatim! Pre-1900 authentic task meaning in the original defenition.