pw_tokenizer: Clarify directory database format This change specifies what a directory database consists of, that searching is recursive, and the suffix necessary for token database files to be included. This information was previously only discoverable via reading the Pigweed source. Change-Id: I0f0f14cfbecd94706d0fe7139a65aadf0b52998e Reviewed-on: https://pigweed-review.googlesource.com/c/pigweed/pigweed/+/128750 Pigweed-Auto-Submit: Taylor Cramer <cramertj@google.com> Reviewed-by: Keir Mierle <keir@google.com> Commit-Queue: Auto-Submit <auto-submit@pigweed.google.com.iam.gserviceaccount.com> Reviewed-by: Carlos Chinchilla <cachinchilla@google.com>
Pigweed is an open source collection of embedded-targeted libraries–or as we like to call them, modules. These modules are building blocks and infrastructure that enable faster and more reliable development on small-footprint MMU-less 32-bit microcontrollers like the STMicroelectronics STM32L452 or the Nordic nRF52832.
For more information please see our website: https://pigweed.dev/.