Task #1695
open
Repo-ng slowdown for large repo sizes
Added by Jeff Burke almost 11 years ago.
Updated almost 11 years ago.
Description
For the BAMS/BMS demo application by Wentao, repo-ng becomes unusably slow for databases around 1GB or more. This application involves 1Hz sampling of ~20 data points, each stored as a data object for now. Performance should be improved for large data sets of small objects.
- Status changed from New to In Progress
- % Done changed from 0 to 10
Index and storage are under developing. It's hard to tell the performance. But complexity and size of skiplist and btree are similar. Tests of performance will be conducted after basic functions are done.
- % Done changed from 10 to 80
The implementation of repoStorage, including index and sqlite, has been finished and merged.
Can you also push the repo "smoketest" to the repo-ng repository?
This issue can be closed after somebody verifies that the described issue has been resolved.
Also available in: Atom
PDF