Page MenuHomePhabricator

Language assets for Hindi
Closed, ResolvedPublic

Description

In parallel we need a list of "badwords" and "informal words".

  • Bad words are words that would be commonly associated with vandalism. They are generally used to insult or be vulgar. This includes curse words, racial slurs, assertions of- and prejudices against sexual preferences.
  • Informal words are words unwelcome on article namespace but would be acceptable on talk pages. This would include words such as 'hello' or 'hahaha' which would be fine in discussions but not in articles.

Related Objects

Event Timeline

I found http://www.youswear.com/index.asp?language=Hindi after searching the internet for "hindi curse words"

Do you need running Bad-Words-Detection-System for Hindi or these badwords are enough?

@Ladsgroup I think we'll still want a Bad-Words-Detection-System as that helps flag the terms as they appear in the wiki We can merge the lists together.

I made this but I'm not sure it's correct, maybe I'm missing some letters in hi language. That's my letters कखगघङचछजझञटठडढणतथदधनपफबभमयरलवशषसहळक्षज्ञ:अपआपाइपिईपीउपुऊपूऋपृॠपॄऌपॢॡपॣएपेऐपैओपोऔपौअंपंअःपः

I made this but I'm not sure it's correct, maybe I'm missing some letters in hi language. That's my letters कखगघङचछजझञटठडढणतथदधनपफबभमयरलवशषसहळक्षज्ञ:अपआपाइपिईपीउपुऊपूऋपृॠपॄऌपॢॡपॣएपेऐपैओपोऔपौअंपंअःपः

The letters are correct. Only mentioning that letters such as पापीपु, etc. mentioned after अ are not alphabets as is but formed by combination of vowels and consonants.
So consonants would be - कखगघङचछजझञटठडढणतथदधनपफबभमयरलवशषसहळक्षज्ञ:
and vowels - अआइईउऊऋॠऌॡएऐओऔअंअः
and an example of combination - प + ई = पी

@Ladsgroup, Can you tell how the list was generated?

Order is not important, the important part is that it covers all letters in Hindi, It makes a regex like this [letters]{2,} to catch words.