Back to Arena
Dify
by LangGenius
System Card
OrganizationLangGenius
Released2023-04
Architectureagentic-workflow / LLMOps platform with workflow + RAG memory
DetailsFull-stack LLM app platform: workflow editor, RAG pipeline, agent capabilities, model management, observability. Conversation memory + variable memory at node level; Postgres + object storage.
Parameters—
Domainagent-memoryrag-retrieval
Open SourceYes
WebsiteVisit
CodeRepository
llmopsworkflowagentk8s
Capability Profile
Benchmark Scores
6 of 14 benchmarksLong-Context Retrieval1/5
Multi-Turn Recall1/2
MemoryBank
no dataCross-Session Memory1/1
Multi-Hop QA2/3
Agent Task Memory1/1
Personalization0/1
PerLTQA
no dataFactuality / Grounding0/1
RAGAS
no dataSources:Dify (langgenius/dify); evaluated on HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering (Stanford / CMU, 1809)Dify (langgenius/dify); evaluated on MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries (HKUST, 2401)Dify (langgenius/dify); evaluated on AgentBench Memory Track (Tsinghua KEG, 2308)Dify (langgenius/dify); evaluated on LoCoMo: Long-Term Conversational Memory Benchmark (Snap Research, 2402)Dify (langgenius/dify); evaluated on LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (Tsinghua KEG, 2308)Dify (langgenius/dify); evaluated on LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory (Salesforce AI Research, 2410)