Skip to content

lilubot/nima-bench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

2 Commits
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

nima-bench

Benchmark suite for NIMA memory system. External to nima-core โ€” testing only.

Benchmarks

Benchmark Status NIMA Score Supermemory
LongMemEval ๐Ÿ”ง Ready to run TBD 81.6%
LoCoMo ๐Ÿ”œ Planned โ€” #1
ConvoMem ๐Ÿ”œ Planned โ€” #1

Quick start

cd longmemeval
bash download_data.sh
python eval.py --limit 50

About

Benchmark suite for NIMA memory system

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors