pragmatic_tokenizer 2.2.0
A multilingual tokenizer to split a string into tokens.
Gemfile:
=
Installeer:
=
Runtime afhankelijkheden (1):
unicode_case_converter
~> 1.0