Cap retained `encoded_tags_` capacity and use `std::array<uint32_t, 14>` in `TransposeEncoder::MessageNode`.

Release `encoded_tags_` buffers larger than `262,144` tags (`1 MiB`) once transitions are written in `WriteStatesAndData()` and in `Clear()`, retaining normal `<= 1 MiB` tag buffers across chunks while preventing multi-MiB spike buffers from staying retained for the lifetime of an encoder. Also replace `absl::InlinedVector<uint32_t, 14>` in `MessageNode::encoded_tag_pos` with `std::array<uint32_t, 14>` (`GetPosInTagsList()` indexes only `Subtype` values `0..13` for `kMaxVarintInline == 3`, shrinking `sizeof(MessageNode)` from `80` to `72` bytes and removing per-lookup size/branch checks).

PiperOrigin-RevId: 1018771374
3 files changed
tree: 3bfabcb3f830d4d58540b7c8fd578b4ace979bf0
  1. .github/
  2. doc/
  3. python/
  4. riegeli/
  5. tf_dependency/
  6. .bazelrc
  7. configure
  8. CONTRIBUTING.md
  9. LICENSE
  10. MANIFEST.in
  11. MODULE.bazel
  12. README.md
README.md

Riegeli

Riegeli/records is a file format for storing a sequence of string records, typically serialized protocol buffers. It supports dense compression, fast decoding, seeking, detection and optional skipping of data corruption, filtering of proto message fields for even faster decoding, and parallel encoding.

See documentation.

Status

Riegeli file format will only change in a backward compatible way (i.e. future readers will understand current files, but current readers might not understand files using future features).

Riegeli C++ API might change in incompatible ways.