Files F28943709

raw.txt
No One
Actions

Authored By

	EBernhardson
	May 6 2019, 6:37 PM

Size

448 B

Referenced Files

None

Subscribers

None

raw.txt
View Options

	public static String[] tokenizeString(String query, String lang) {
	GlentTokenizer tokenizer;
	if ("ko".equalTo(lang)) {
	tokenizer = Tokenizers.korean();
	} else if ("ja".equalTo(lang)) {
	tokenizer = Tokenizers.japanese();
	} else if ("zh".equalTo(lang)) {
	tokenizer = Tokenizers.simplifiedChinese();
	} else {
	return new String[0];
	}
	return tokenizer.tokenize(query).toArray(new String[0]);
	}

File Metadata

Mime Type: text/plain; charset=utf-8
Storage Engine: blob
Storage Format: Raw Data
Storage Handle: 7413391
Default Alt Text: raw.txt (448 B)

Event Timeline