AIFIRST Viral '178x token reduction' claims debunked; memory is the hard problem
The brief
A satirical debunk shows viral token-reduction math ignores output tokens, cache writes and multi-turn costs.
Key points
- The real point: retrieval is largely solved, persistent memory across sessions is the unsolved problem for.
Sources
- r/OpenSourceeAIreddit.com