tokenizers 0.1.3
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
インストール:
=
バージョン履歴:
- 0.5.3 September 17, 2024 x86_64-linux (5.91MB)
- 0.5.3 September 17, 2024 x86_64-linux-musl (5.89MB)
- 0.5.3 September 17, 2024 x86_64-darwin (6.17MB)
- 0.5.3 September 17, 2024 x64-mingw-ucrt (8.09MB)
- 0.5.3 September 17, 2024 arm64-darwin (5.87MB)
- 0.1.3 October 07, 2022 (23.5KB)