Page MenuHomePhabricator

[wiki-nlp-tools] Evaluation: expand the existing testing modules
Open, Needs TriagePublic

Description

Currently we have some basic test functions for word/sentence tokenizations. But they only contain English examples. We need to update these to accommodate a few more scripts.