tree 0d9fec7fe3e78bb9ae26132b84ed9cefb20ef8ea
parent dcfcecf84808f9265a78640884b246a9149f8f11
author Wyatt Hepler <hepler@google.com> 1615905768 -0700
committer CQ Bot Account <pigweed-scoped@luci-project-accounts.iam.gserviceaccount.com> 1615907824 +0000

pw_tokenizer: Decode token databases as UTF-8

Windows doesn't default to UTF-8.

Change-Id: I9a3d5e6034044f7085dd3fe056f33aa12e58e105
Reviewed-on: https://pigweed-review.googlesource.com/c/pigweed/pigweed/+/37960
Pigweed-Auto-Submit: Wyatt Hepler <hepler@google.com>
Commit-Queue: Auto-Submit <auto-submit@pigweed.google.com.iam.gserviceaccount.com>
Reviewed-by: Ewout van Bekkum <ewout@google.com>