Back to Arena

SCM

by Beihang / NLPR (Wang et al.)

System Card

OrganizationBeihang / NLPR (Wang et al.)
Released2023-04
Architectureagentic-workflow / Agent + memory stream + memory controller
DetailsThree components: an LLM-based agent, a memory stream storing agent memories, and a memory controller that decides when and how to use memories. Plug-and-play, no fine-tuning, supports inputs up to 2M tokens.
Parameters—
Domainlong-contextagent-memoryepisodic-session
Open SourceYes
PaperView Paper
CodeRepository
plug-and-playmemory-controllerultra-long-contextdialogue

Capability Profile

Benchmark Scores

6 of 14 benchmarks
Data Transparency:6 estimated
Long-Context Retrieval
1/5
RULER
no data
NIAH
no data
LooGLE
no data
LongBench
no data
∞Bench
76.225pEstimated
Multi-Turn Recall
1/2
LoCoMo
82.993pEstimated
MemoryBank
no data
Cross-Session Memory
1/1
LongMemEval
78.265pEstimated
Multi-Hop QA
2/3
BABILong
81.393pEstimated
MultiHop-RAG
no data
HotpotQA
78.493pEstimated
Agent Task Memory
1/1
AgentBench-Mem
7226pEstimated
Personalization
0/1
PerLTQA
no data
Factuality / Grounding
0/1
RAGAS
no data
Sources:Arena estimate — derived from capability profile, not independently verified