Page MenuHomePhabricator
Paste P6872

(An Untitled Masterwork)
ActivePublic

Authored by awight on Mar 21 2018, 4:05 PM.
Tags
None
Referenced Files
F15947656:
Mar 21 2018, 4:05 PM
Subscribers
None
# Damaging model
--- master_cswiki_info 2018-03-20 19:06:10.149174266 +0000
+++ simplify_template_cswiki_info 2018-03-21 16:02:06.700442411 +0000
@@ -1,7 +1,7 @@
Model Information:
- type: GradientBoosting
- version: 0.4.0
- - params: {'max_leaf_nodes': None, 'random_state': None, 'min_samples_leaf': 1, 'init': None, 'min_weight_fraction_leaf': 0.0, 'verbose': 0, 'presort': 'auto', 'n_estimators': 500, 'learning_rate': 0.01, 'population_rates': None, 'multilabel': False, 'subsample': 1.0, 'scale': True, 'labels': [True, False], 'warm_start': False, 'loss': 'deviance', 'max_depth': 7, 'label_weights': OrderedDict([(True, 10)]), 'min_samples_split': 2, 'max_features': 'log2', 'center': True}
+ - params: {'population_rates': None, 'init': None, 'subsample': 1.0, 'center': True, 'max_depth': 7, 'min_weight_fraction_leaf': 0.0, 'max_features': 'log2', 'warm_start': False, 'loss': 'deviance', 'min_samples_split': 2, 'max_leaf_nodes': None, 'random_state': None, 'n_estimators': 500, 'scale': True, 'min_samples_leaf': 1, 'presort': 'auto', 'multilabel': False, 'labels': [True, False], 'label_weights': OrderedDict([(True, 10)]), 'learning_rate': 0.01, 'verbose': 0}
Environment:
- revscoring_version: '2.1.0'
- platform: 'Linux-4.9.0-5-amd64-x86_64-with-debian-9.3'
@@ -18,64 +18,64 @@
- release: '4.9.0-5-amd64'
Statistics:
- counts (n=17914):
+ counts (n=17794):
label n ~True ~False
------- ----- --- ------- --------
- True 451 --> 221 230
- False 17463 --> 395 17068
+ True 451 --> 224 227
+ False 17343 --> 400 16943
rates:
True False
---------- ------ -------
sample 0.025 0.975
population 0.045 0.955
- match_rate (micro=0.916, macro=0.5):
+ match_rate (micro=0.915, macro=0.5):
False True
------- ------
- 0.957 0.043
- filter_rate (micro=0.084, macro=0.5):
+ 0.956 0.044
+ filter_rate (micro=0.085, macro=0.5):
False True
------- ------
- 0.043 0.957
- recall (micro=0.956, macro=0.734):
+ 0.044 0.956
+ recall (micro=0.956, macro=0.737):
False True
------- ------
- 0.977 0.49
- !recall (micro=0.512, macro=0.734):
+ 0.977 0.497
+ !recall (micro=0.518, macro=0.737):
False True
------- ------
- 0.49 0.977
- precision (micro=0.955, macro=0.74):
+ 0.497 0.977
+ precision (micro=0.955, macro=0.739):
False True
------- ------
- 0.976 0.503
- !precision (micro=0.524, macro=0.74):
+ 0.977 0.501
+ !precision (micro=0.522, macro=0.739):
False True
------- ------
- 0.503 0.976
- f1 (micro=0.955, macro=0.737):
+ 0.501 0.977
+ f1 (micro=0.955, macro=0.738):
False True
------- ------
- 0.977 0.496
- !f1 (micro=0.518, macro=0.737):
+ 0.977 0.499
+ !f1 (micro=0.52, macro=0.738):
False True
------- ------
- 0.496 0.977
+ 0.499 0.977
accuracy (micro=0.956, macro=0.956):
False True
------- ------
0.956 0.956
- fpr (micro=0.488, macro=0.266):
+ fpr (micro=0.482, macro=0.263):
False True
------- ------
- 0.51 0.023
+ 0.503 0.023
roc_auc (micro=0.921, macro=0.921):
False True
------- ------
0.921 0.92
- pr_auc (micro=0.973, macro=0.746):
+ pr_auc (micro=0.973, macro=0.748):
False True
------- ------
- 0.995 0.498
+ 0.995 0.501
- - score_schema: {'properties': {'probability': {'properties': {'false': 'number', 'true': 'number'}, 'description': 'A mapping of probabilities onto each of the potential output labels', 'type': 'object'}, 'prediction': {'description': 'The most likely label predicted by the estimator', 'type': 'bool'}}, 'title': 'Scikit learn-based classifier score with probability', 'type': 'object'}
+ - score_schema: {'properties': {'probability': {'properties': {'true': 'number', 'false': 'number'}, 'type': 'object', 'description': 'A mapping of probabilities onto each of the potential output labels'}, 'prediction': {'type': 'bool', 'description': 'The most likely label predicted by the estimator'}}, 'type': 'object', 'title': 'Scikit learn-based classifier score with probability'}