[Execution state] complete ledger - Separate storage of payloads (original) (raw)

Problem Definition

Currently, we do keep payloads as part of the leaf nodes and in memory, if we store them on a disk-based data store we can separate the index (trie) from the actual data. and that should reduce memory usage drastically. should also improve garbage collection.

This should be done in a way that doesn't impact the time spent on operations like read and update and be parallelizable as much as possible.