Change Details

The [[https://public-paws.wmcloud.org/User:Isaac (WMF)/Quality/Quality_Model_Evaluation.ipynb|existing evaluation for the model]] does so across five languages: Arabic, English, French, Hungarian, and Turkish. Chinese Wikipedia (zhwiki) now also uses the PageAssessments extension from which we retrieve the groundtruth data, so we can add it to that list! Adding it will require: [] Implementing a `zhqual_to_enqual` function ([[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Formatting-groundtruth-data|examples for French/Arabic/Turkish/Hungarian]]) [] Adding the analysis to [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Retrieve-recent-groundtruth-data|the bottom of the notebook]] [] Adding the results to the [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#High-level-Result-Summary|summary in the top]] Resources: * [[https://zh.wikipedia.org/wiki/Wikipedia:%E9%A1%B5%E9%9D%A2%E8%B4%A8%E9%87%8F%E8%AF%84%E7%BA%A7%E6%A0%87%E5%87%86|Chinese Wikipedia quality rubric]] * [[https://superset.wmcloud.org/sqllab?savedQueryId=84|Current ratings in database that will need translated into English quality classes]] NOTE: not all of the existing quality ratings for zhwiki will be translate-able into the English quality classes we're using (stub/start/c/b/ga/fa) but we should hopefully be able to get examples for each of these classes and not throw away too much data.

The [[https://public-paws.wmcloud.org/User:Isaac (WMF)/Quality/Quality_Model_Evaluation.ipynb|existing evaluation for the model]] does so across five languages: Arabic, English, French, Hungarian, and Turkish. Chinese Wikipedia (zhwiki) now also uses the PageAssessments extension from which we retrieve the groundtruth data, so we can add it to that list! Adding it will require: [x] Implementing a `zhqual_to_enqual` function ([[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Formatting-groundtruth-data|examples for French/Arabic/Turkish/Hungarian]]) [x] Adding the analysis to [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Retrieve-recent-groundtruth-data|the bottom of the notebook]] [] Adding the results to the [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#High-level-Result-Summary|summary in the top]] Resources: * [[https://zh.wikipedia.org/wiki/Wikipedia:%E9%A1%B5%E9%9D%A2%E8%B4%A8%E9%87%8F%E8%AF%84%E7%BA%A7%E6%A0%87%E5%87%86|Chinese Wikipedia quality rubric]] * [[https://superset.wmcloud.org/sqllab?savedQueryId=84|Current ratings in database that will need translated into English quality classes]] NOTE: not all of the existing quality ratings for zhwiki will be translate-able into the English quality classes we're using (stub/start/c/b/ga/fa) but we should hopefully be able to get examples for each of these classes and not throw away too much data.

The [[https://public-paws.wmcloud.org/User:Isaac (WMF)/Quality/Quality_Model_Evaluation.ipynb|existing evaluation for the model]] does so across five languages: Arabic, English, French, Hungarian, and Turkish. Chinese Wikipedia (zhwiki) now also uses the PageAssessments extension from which we retrieve the groundtruth data, so we can add it to that list! Adding it will require: [x] Implementing a `zhqual_to_enqual` function ([[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Formatting-groundtruth-data|examples for French/Arabic/Turkish/Hungarian]]) [x] Adding the analysis to [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#Retrieve-recent-groundtruth-data|the bottom of the notebook]] [] Adding the results to the [[https://public-paws.wmcloud.org/User:Isaac%20(WMF)/Quality/Quality_Model_Evaluation.ipynb#High-level-Result-Summary|summary in the top]] Resources: * [[https://zh.wikipedia.org/wiki/Wikipedia:%E9%A1%B5%E9%9D%A2%E8%B4%A8%E9%87%8F%E8%AF%84%E7%BA%A7%E6%A0%87%E5%87%86|Chinese Wikipedia quality rubric]] * [[https://superset.wmcloud.org/sqllab?savedQueryId=84|Current ratings in database that will need translated into English quality classes]] NOTE: not all of the existing quality ratings for zhwiki will be translate-able into the English quality classes we're using (stub/start/c/b/ga/fa) but we should hopefully be able to get examples for each of these classes and not throw away too much data.