Generative AI hallucinations, speculations, hype & beyond

sbagency
3 min readApr 26, 2023

--

What’s wrong with LLMs? Hallucinating.

What’s wrong with AI-hype? Speculating.

In the beginning was the word. Language is the operating system of human culture. From language emerges myth and law, gods and money, art and science, friendships and nations and computer code. A.I.’s new mastery of language means it can now hack and manipulate the operating system of civilization. By gaining mastery of language, A.I. is seizing the master key to civilization, from bank vaults to holy sepulchers. link

Language models can generate text just like calculators calculate numbers, there is no intelligence. // actually LLMs transform text to numbers

LLMs == text calculators, there is no AI/AGI

Natural language is the natural way to prompt and program computing systems. But there is a risk of prompt misunderstanding and hallucinations in generated answers.

RLHF isn’t a solution, it’s a patch.

NN has a “knowledge graph” stored in weights, with confidence level on each node.

link
https://arxiv.org/pdf/2304.11090.pdf

There is a growing trend that foundation models will serve as the fundamental building blocks for most of the future AI systems. However, incorporating foundation models in AI systems raises significant concerns about responsible AI due to their black box nature and rapidly advancing super-intelligence

https://www.wired.com/story/stack-overflow-will-charge-ai-giants-for-training-data/
https://huggingface.co/blog/peft
https://twitter.com/karpathy/status/1645115622517542913
https://arxiv.org/pdf/2304.11062.pdf

GPT “agents” can prompt Itself and each other

https://github.com/Significant-Gravitas/Auto-GPT
task-driven-autonomous-agent-utilizing-gpt-4-pinecone-and-langchain-for-diverse-applications/
https://twitter.com/DataChaz/status/1650920713669189639
https://huggingface.co/spaces/llamaindex/llama_agi_auto

AI hype is beyond the limits. Language models can generate prompts to itself and other models. Continuous process of generating new prompts can be extended by external scripts, plugins and data sources. Is there super intelligence? Actually no, just data processing, but with new cool capabilities.

For example, in this loop a new code/scripts can be generated as well and executed. This process is a subject of optimization. Will evolve and improve over time. According to this scenario, users just formulate the high level goals, no prompt engineering, coding, etc.

We are at a new stage of a significant paradigm shift in the way computing systems work…

// in progress

--

--

sbagency
sbagency

Written by sbagency

Tech/biz consulting, analytics, research for founders, startups, corps and govs.

No responses yet