Back to Arena

Memory³

by Institute for Advanced Algorithms Research Shanghai / Peking University

System Card

OrganizationInstitute for Advanced Algorithms Research Shanghai / Peking University
Released2024-07
Architecturekv-cache-extension / Third memory form: explicit KV memory
DetailsIntroduces explicit memory as a third memory form (after implicit weights and context KVs). References are pre-written to disk as sparsified attention key-value vectors, then recalled during inference with a memory circuitry theory and two-stage pretraining.
Parameters—
Domainlong-contextknowledge-graph
Open SourceNo
PaperView Paper
explicit-memorykvsparsificationpretraining

Capability Profile

Benchmark Scores

6 of 14 benchmarks
Data Transparency:6 estimated
Long-Context Retrieval
3/5
RULER
no data
NIAH
no data
LooGLE
74.532pEstimated
LongBench
603pEstimated
∞Bench
77.231pEstimated
Multi-Turn Recall
0/2
LoCoMo
no data
MemoryBank
no data
Cross-Session Memory
1/1
LongMemEval
51.30pEstimated
Multi-Hop QA
2/3
BABILong
7328pEstimated
MultiHop-RAG
no data
HotpotQA
57.67pEstimated
Agent Task Memory
0/1
AgentBench-Mem
no data
Personalization
0/1
PerLTQA
no data
Factuality / Grounding
0/1
RAGAS
no data
Sources:Arena estimate — derived from capability profile, not independently verified