Introduce private `kMaxPosition` constants instead of repeating an expression
for the limit.

Special cases:

* In `SnappyWriterBase::PushSlow()`, continue to use a higher limit than
  `kMaxPosition` to allow creating a larger buffer near the end of the supported
  range and filling it partially.

* Fix `riegeli::tensorflow::FileWriter`: the position is limited by `int64_t`,
  as evidenced by `tsl::WritableFile::Tell()`.

PiperOrigin-RevId: 917084196
98 files changed
tree: a9e42d8eb08f87437cca7194df3461a0a9bd31a8
  1. doc/
  2. python/
  3. riegeli/
  4. tf_dependency/
  5. .bazelrc
  6. configure
  7. CONTRIBUTING.md
  8. LICENSE
  9. MANIFEST.in
  10. MODULE.bazel
  11. README.md
README.md

Riegeli

Riegeli/records is a file format for storing a sequence of string records, typically serialized protocol buffers. It supports dense compression, fast decoding, seeking, detection and optional skipping of data corruption, filtering of proto message fields for even faster decoding, and parallel encoding.

See documentation.

Status

Riegeli file format will only change in a backward compatible way (i.e. future readers will understand current files, but current readers might not understand files using future features).

Riegeli C++ API might change in incompatible ways.