Change Details

Once we have a set of [[ https://phabricator.wikimedia.org/T299428 | word tokens ]] identified in the wikitext, we want to know if any of them are uppercase words. This will allow us to build the credibility signals related to uppercase words. An uppercase word is a word token that has length >1 and all characters in the token are uppercase. [[ https://github.com/wikimedia/revscoring/blob/0c55e1d334231565c3233d945efb2987d4054cf1/revscoring/features/wikitext/datasources/tokenized.py#L423 | Here ]] is code to copy/paste. This utility will live under structured-data/packages.

Once we have a set of [[ https://phabricator.wikimedia.org/T299428 | word tokens ]] identified in the wikitext, we want to know if any of them are uppercase words. This will allow us to build the credibility signals related to uppercase words. A couple of lines of code to copy. An uppercase word is a word token that has length >1 and all characters in the token are uppercase. [[ https://github.com/wikimedia/revscoring/blob/0c55e1d334231565c3233d945efb2987d4054cf1/revscoring/features/wikitext/datasources/tokenized.py#L423 | Here ]] is code to copy/paste. This utility will live under structured-data/packages.

Once we have a set of [[ https://phabricator.wikimedia.org/T299428 | word tokens ]] identified in the wikitext, we want to know if any of them are uppercase words. This will allow us to build the credibility signals related to uppercase words. A couple of lines of code to copy. An uppercase word is a word token that has length >1 and all characters in the token are uppercase. [[ https://github.com/wikimedia/revscoring/blob/0c55e1d334231565c3233d945efb2987d4054cf1/revscoring/features/wikitext/datasources/tokenized.py#L423 | Here ]] is code to copy/paste. This utility will live under structured-data/packages.