- Identify the different language family/Clusters
- Train sentencepiece for each clusters separately
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Appledora | T316941 NLP Tools for Content Gaps | |||
| Resolved | Appledora | T328264 NLP Tools: Word Tokenization | |||
| Declined | Appledora | T328267 Word Tokenization: Non-whitespace languages | |||
| Declined | Appledora | T328269 Sentencepiece: Language Family Wise training |