Change Details

####Description Some of the modules through different wikis will always do the same, but will have minor differences. For example, `Module:Yesno` always provide the same service - but its code would be different, as words for positive and negative answers are translated to the language of the wiki, where this module is used. What can we look at? - [ ] Code similarity - ASL trees and other different technics - but it's important to prepare the data and use it only as a last step, as the initial amount of data is huge, and this analysis require quite a lot of computations. - [ ] Title analysis - some of the modules have some changes to the sourcecode to adapt it, but save the title (as `Yesno`, mentioned before). These modules can be distinguished quite easy, and it will lighten further analysis. - [ ] Function usage - if some script is highly popular, it's highly unlikely that it's complitely unique, as it should implement something very useful.

####Description Some of the modules through different wikis will always do the same, but will have minor differences. For example, `Module:Yesno` always provide the same service - but its code would be different, as words for positive and negative answers are translated to the language of the wiki, where this module is used. What can we look at? - [ ] Code similarity - ASL trees and other different technics - but it's important to prepare the data and use it only as a last step, as the initial amount of data is huge, and this analysis require quite a lot of computations. - [ ] Title analysis - some of the modules have some changes to the sourcecode to adapt it, but save the title (as `Yesno`, mentioned before). These modules can be distinguished quite easy, and it will lighten further analysis. - [ ] Function usage - if some script is highly popular, it's highly unlikely that it's complitely unique, as it should implement something very useful. Jade's Python notebook on content analysis of modules under the same title: [[ https://public.paws.wmcloud.org/User:LostEnchanter/Content%20analysis.ipynb | here ]]

####Description Some of the modules through different wikis will always do the same, but will have minor differences. For example, `Module:Yesno` always provide the same service - but its code would be different, as words for positive and negative answers are translated to the language of the wiki, where this module is used. What can we look at? - [ ] Code similarity - ASL trees and other different technics - but it's important to prepare the data and use it only as a last step, as the initial amount of data is huge, and this analysis require quite a lot of computations. - [ ] Title analysis - some of the modules have some changes to the sourcecode to adapt it, but save the title (as `Yesno`, mentioned before). These modules can be distinguished quite easy, and it will lighten further analysis. - [ ] Function usage - if some script is highly popular, it's highly unlikely that it's complitely unique, as it should implement something very useful. Jade's Python notebook on content analysis of modules under the same title: [[ https://public.paws.wmcloud.org/User:LostEnchanter/Content%20analysis.ipynb | here ]]