Researchers Recreate Human Episodic Memory to Give LLMs Infinite Context

Posted under: Digital Transformation
Date: 2024-07-17
Researchers Recreate Human Episodic Memory to Give LLMs Infinite Context

Researchers from Huawei and University College London developed EM-LLM to emulate human episodic memory in large language models (LLMs). This innovation allows LLMs to have infinite context lengths without increased computing power. EM-LLM organizes tokens into events using Bayesian surprise and graph-theoretic methods, enhancing LLM performance on long-context tasks, and outperforming other approaches by significant margins.

Read more at: analyticsindiamag.com