pragmatic_tokenizer 3.0.5
A multilingual tokenizer to split a string into tokens.
Gemfile:
=
インストール:
=
Runtime依存関係 (1):
unicode
>= 0
A multilingual tokenizer to split a string into tokens.