Maniphest T160755

Fix tokenization for Korean
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Halfak
	Mar 17 2017, 2:50 PM

Tags

Referenced Files

None

Subscribers

Description

It's space delimited!

e.g. "위키백과의 운영은 비영리 단체인 위키미디어 재단이"

Event Timeline

Halfak created this task.Mar 17 2017, 2:50 PM

Restricted Application added subscribers: revi, Aklapper. · View Herald TranscriptMar 17 2017, 2:50 PM

https://github.com/halfak/deltas/commit/36a51c23f4c6dd93bda3c0662d0607078e72828a

This is now fixed in version 0.4.5 of deltas

Halfak claimed this task.Mar 20 2017, 4:52 PM

Halfak moved this task from Parked to Completed on the Machine-Learning-Team (Active Tasks) board.

Halfak closed this task as Resolved.Apr 14 2017, 5:41 PM