Path to reader version 3, writer version 7 transaction log protocol support · Issue #1568 · delta-io/delta-rs (original) (raw)

Description

Delta Lake transitioned to table features and now has a better upgrade path for connectors.

delta-rs can upgrade to protocol version 3,7 (skipping the intermediate protocol versions) and then cherry pick the table features that will be supported.

Adding table feature support may also make it safer when reading Delta tables with delta-rs. Does delta-rs gracefully error out when reading a table with table features that are enabled that delta-rs does not currently support?

The purpose of this issue is to organize the remaining work that's needed to get protocol version 3,7 support. Seems like delta-rs is close.