Back to Benchmarks

MemoryBank

MemoryBank: Enhancing LLMs with Long-Term Memory

Benchmark Metadata

PublisherSun Yat-sen University
VenueAAAI 2024
Evaluation Typehuman
Dimensions3
Test Prompts194
ScoringHigher is better
Update Frequencyad-hoc
LeaderboardView Leaderboard

What It Measures

  • Recall of past dialogue facts
  • Personality and preference consistency
  • Empathy-grounded response quality

What It Does Not Measure

  • Long document retrieval
  • Multi-hop reasoning
  • Latency

All Systems Evaluated(88 systems)

RankSystemScore
#1Character AICharacter.AI (Google investment)85
#2Friend AIFriend85
#3Limitless PendantLimitless AI (acquired by Meta Dec 2025)85
#4Pickle AISoul Computer (YC-backed)85
#5ReplikaLuka, Inc.85
#6Talkie AIMiniMax85
#7Pi InflectionInflection AI83.9
#8Tab AITab (Avi Schiffmann)82.8
#9ArcMemoUC Berkeley / Stanford (Ho et al.)82.7
#10MemoryBankInstitute of Software, Chinese Academy of Sciences81.8
#11MemoryBankHarbin Institute of Technology / SenseTime81.8
#12Lindy AILindy AI81.5
#13Bee ComputerBee (acquired by Amazon 2026)81.4
#14SupermemorySupermemory81.2
#15Charlie MnemonicGoodAI81.1
#16Second MeMindverse (Shang, Li, et al.)81.1
#17xmemoryxmemory Inc.80.5
#18MempZhejiang University (Fang et al.)80.3
#19MemPalaceBen Sigman / Milla Jovovich (independent open-source)80.3
#20JARVIS-1CraftJarvis79.8
#21ExpeLTsinghua University (Zhao et al.)79.6
#22MIRIXMIRIX AI (Wang, Chen)79.4
#23Nomi AIGlimpse AI, Inc.78.8
#24Think-in-MemoryAnt Group / Alibaba (Liu et al.)78.8
#25CognigyCognigy GmbH (acquired by NICE, July 2025)78.6
#26ReflexionNortheastern / MIT / Princeton (Shinn et al.)78.4
#27GPTeam101dotxyz78.3
#28Mem0Mem078
#29SynapseNTU / Salesforce (Zheng et al.)78
#30Agent Workflow MemoryCMU (Wang, Mao, Fried, Neubig)77.9
#31D-MemYou et al. (2025)77.9
#32A-MEMAGI Research / Rutgers77.5
#33AbridgeAbridge77.4
#34Nabla CopilotNabla77.4
#35NemoriNemori AI (independent)77.4
#36CrewAI EnterpriseCrewAI Inc.77
#37ParadotWithFeeling.AI76.9
#38Kore AIKore.ai Inc.76.8
#39AgentVerseOpenBMB (Tsinghua)76.7
#40Nuance DAXNuance Communications (Microsoft)76.1
#41VoyagerNVIDIA / Caltech / UT Austin / Stanford / ASU / UW (Wang et al.)75.7
#42Plaud NotePLAUD75.6
#43KindroidKindroid75.3
#44MemOSMemTensor (Li, Zhang, et al.)75.3
#45OS-Copilot / FRIDAYShanghai AI Lab / MMLab (Wu et al.)75.3
#46Granola AIGranola75.1
#47memUNevaMind-AI75.1
#48Suki AISuki (formerly Robin AI)75
#49MultiOnMultiOn (now AGI Inc.)74.9
#50BabyAGIYohei Nakajima74.7
#51MoTFudan (Li, Qiu)74.7
#52RMMGoogle / UCSB (2025)74.7
#53Open InterpreterOpenInterpreter74.5
#54MemoryScopeAlibaba ModelScope74.3
#55LangGraphLangChain74.2
#56Memoripycaspianmoon74.1
#57RecallMCisco Research / independent (Kynoch & Latapie)73.9
#58CradleBAAI-Agents73.7
#59Generative AgentsStanford University / Google Research73.7
#60SynapseNanyang Technological University (Zheng et al.)73.4
#61MoTFudan University (Li & Qiu)73.1
#62VoiceflowVoiceflow Inc.73.1
#63MemoriGibsonAI72.6
#64ChatDev 2.0OpenBMB72.3
#65Claude ProjectsAnthropic72
#66Gemini MemoryGoogle71.6
#67BotpressBotpress Inc.71.6
#68LangMemLangChain71.1
#69ChatGPT MemoryOpenAI70.8
#70HiMemZhu et al. (JD.com, 2026)70.7
#71Copilot MemoryMicrosoft69.4
#72Personal AIPersonal AI68
#73Saner AISaner.AI65.7
#74Generative AgentsStanford / Google65.4
#75MemoChatUniversity of Warwick / Alibaba64.9
#76AriGraphAIRI Institute / Moscow64.5
#77Mnemosyneindependent64.4
#78QuivrQuivrHQ64
#79MnemosyneJohns Hopkins / independent (2025)62.6
#80Heyday AIHeyday (shut down 2025)61.8
#81MemoroMIT Media Lab61.6
#82kNN-LMStanford / Facebook AI Research (Khandelwal et al.)61
#83LarimarIBM Research60.4
#84KDB AIKX Systems60.1
#85Nomic AtlasNomic AI Inc.59.6
#86Mem AIMem Labs59.2
#87Notion AINotion Labs58.6
#88Sana AISana Labs55.6