PyPI page
Home page
Author:
ModelCloud
Summary:
A (nicer) tokenizer you want to use for model `inference` and `training`: with all known peventable `gotchas` normalized or auto-fixed.
Latest version:
0.0.5
Required dependencies:
transformers
Downloads last day:
306
Downloads last week:
2,465
Downloads last month:
10,991