Home › Forums › Decaffeinated Coffee › Re: Geneiva is Geneva Switzerland according to AI › Reply To: Re: Geneiva is Geneva Switzerland according to AI
Non> how LLMs (Large Language Models) AI work,
Well, first, nobody, even LLM, knows how exactly it works, of course …
Note that while LLM is not fully coded by the programmer, it is dependent on the training data that programmer fed into LLM. One hypothesis from an expert is that the current generation of LLMs is the best we will have (contrary to the usual always-improving tech). Explanation: LLM learns from publicly available texts. Next generation of human writers will be writing with the help of current LLMs, directly or indirectly, leading to decreasing quality while increasing quantity. Thus, next generation of LLMs will be essentially learning from the noisy data it generated. This is an AI version of “yeridas hadoros”.
This is somewhat believable as we already see now that people using Internet are not always smarter than people reading seforim… I am hopeful, though, that we still have enough of informed individuals who will understand the problem and start training LLMs on a combination of Plato, Aristotle, Gemora and Rashi.