PerLTQA

Name: PerLTQA: A Personal Long-Term Memory Question Answering Dataset
Creator: PolyU
Keywords: personalization-eval, personalization, agent-memory

PerLTQA: A Personal Long-Term Memory Question Answering Dataset

Benchmark Metadata

PublisherPolyU

VenuearXiv preprint

Evaluation Typeautomatic

Dimensions3

Test Prompts8,593

ScoringHigher is better

Update Frequencyannual

PaperView Paper

LeaderboardView Leaderboard

What It Measures

Personal semantic-memory recall
Personal episodic-memory recall
Memory-grounded answer accuracy

What It Does Not Measure

Generic factual QA
Code or math reasoning
Latency

All Systems Evaluated(22 systems)

Rank	System	Score	Source
#1	Tab AITab (Avi Schiffmann)	87.8	Tab AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#2	ReplikaLuka, Inc.	86.8	Replika vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#3	Pi InflectionInflection AI	85.7	Pi Inflection vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#4	Limitless PendantLimitless AI (acquired by Meta Dec 2025)	85.5	Limitless Pendant vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#5	Talkie AIMiniMax	84.8	Talkie AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#6	Second MeMindverse (Shang, Li, et al.)	84.6	Second Me paper (arXiv:2503.08102); evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#7	Friend AIFriend	84	Friend AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#8	Character AICharacter.AI (Google investment)	82.8	Character AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#9	Bee ComputerBee (acquired by Amazon 2026)	82.5	Bee Computer vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#10	Charlie MnemonicGoodAI	81.9	Charlie Mnemonic paper (); evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#11	Pickle AISoul Computer (YC-backed)	80.4	Pickle AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#12	ParadotWithFeeling.AI	76.6	Paradot vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#13	Nomi AIGlimpse AI, Inc.	75.7	Nomi AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#14	KindroidKindroid	74.6	Kindroid vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#15	Personal AIPersonal AI	74	Personal AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#16	memUNevaMind-AI	73.2	memU (NevaMind-AI/memU); evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#17	MemoryBankInstitute of Software, Chinese Academy of Sciences	72.6	MemoryBank paper (arXiv:2305.10250); evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#18	Copilot MemoryMicrosoft	67.9	Copilot Memory vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#19	ChatGPT MemoryOpenAI	67.7	ChatGPT Memory vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#20	MnemosyneJohns Hopkins / independent (2025)	67.7	Mnemosyne paper (arXiv:2510.08601); evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#21	Gemini MemoryGoogle	67.4	Gemini Memory vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)
#22	Heyday AIHeyday (shut down 2025)	62.9	Heyday AI vendor documentation; evaluated on PerLTQA: A Personal Long-Term Memory Question Answering Dataset (PolyU, 2402)