Page MenuHomePhabricator
Paste P6413

Raw Cloud VPS web proxy hits 2017-11-29
ActivePublic
Actions

Authored by bd808 on Dec 1 2017, 4:51 AM.
# grep wmflabs access.log.1 |
> awk '{print $1}' |
> awk -F '.' '{for (i=NF-2; i<NF; i++) printf $i "."; print $NF}' |
> sort |
> uniq -c |
> sort -n
1 apertium-beta.wmflabs.org
1 articleplaceholder.wmflabs.org
1 browser-reports-test.wmflabs.org
1 chromium-pdf.wmflabs.org
1 citolytics-de-eval.wmflabs.org
1 citolytics-simple-eval.wmflabs.org
1 dannyb.wmflabs.org
1 deep-learning-services.wmflabs.org
1 devwiki-striker.wmflabs.org
1 drmf.wmflabs.org
1 dumps.wmflabs.org
1 en-wp-bm25-relforge.wmflabs.org
1 getstarted.wmflabs.org
1 grafana.wmflabs.org
1 he-wp-prod-relforge.wmflabs.org
1 huggle-pg.wmflabs.org
1 korma.wmflabs.org
1 librarybase-web.wmflabs.org
1 mast-demo.wmflabs.org
1 mediawiki-vagrant-image.wmflabs.org
1 mirror.wmflabs.org
1 mol-static.wmflabs.org
1 multimedia-alpha.wmflabs.org
1 oganesson.wmflabs.org
1 oidc-google.wmflabs.org
1 osm-estratswproxy-mobile.wmflabs.org
1 partnermetrics.wmflabs.org
1 perf-testing.wmflabs.org
1 phpcs-dashboard.wmflabs.org
1 planet-hotdog.wmflabs.org
1 pluggableauth-server.wmflabs.org
1 portal.wmflabs.org
1 props-repo.wmflabs.org
1 proveit.wmflabs.org
1 recommend-experimental.wmflabs.org
1 recommend-old.wmflabs.org
1 redis-dispatching-repo.wmflabs.org
1 reflex-console.wmflabs.org
1 sentimentalk.wmflabs.org
1 simple.wmflabs.org
1 snuggle-en-new.wmflabs.org
1 stream-beta.wmflabs.org
1 togetherjs-hub.wmflabs.org
1 tools.wmflabs.org
1 wikiapiary.wmflabs.org
1 wikiedubackups.wmflabs.org
1 wikispeech-tts-audio.wmflabs.org
1 wikistats-kraken.wmflabs.org
1 wm-bot2.wmflabs.org
1 women-in-red.wmflabs.org
1 ws-test.wmflabs.org
1 yandex-proxy.wmflabs.org
2 accounts-oauth.wmflabs.org
2 af-lg.wmflabs.org
2 botbot.wmflabs.org
2 cindy.wmflabs.org
2 cirrus-browser-bot.wmflabs.org
2 cx2-testing.wmflabs.org
2 dashboardchat.wmflabs.org
2 deep-learning-services-shell.wmflabs.org
2 download.wmflabs.org
2 dumps-3.wmflabs.org
2 ee-dashboard.wmflabs.org
2 glampipe.wmflabs.org
2 hatjitsu.wmflabs.org
2 instance-proxy.wmflabs.org
2 labels-experiment.wmflabs.org
2 nonfreewiki.wmflabs.org
2 otrs-oneclickspam.wmflabs.org
2 recommendation-api-beta.wmflabs.org
2 relevance.wmflabs.org
2 restbase-reading.wmflabs.org
2 sistersearch.wmflabs.org
2 stack.wmflabs.org
2 v2c2.wmflabs.org
2 v2c3.wmflabs.org
2 visualeditor-test-restbase.wmflabs.org
2 wikibase.wmflabs.org
2 wikidocumentaries.wmflabs.org
3 concur.wmflabs.org
3 discovery-dev.wmflabs.org
3 drmf-mast.wmflabs.org
3 dumps-stats.wmflabs.org
3 fa-tts.wmflabs.org
3 gerrit-zuul.wmflabs.org
3 grantreview-dev.wmflabs.org
3 language-reportcard-test.wmflabs.org
3 mw-expt-tests.wmflabs.org
3 mwstake.wmflabs.org
3 popcorn.wmflabs.org
3 projectbase.wmflabs.org
3 torproxy.wmflabs.org
3 v2c.wmflabs.org
3 wdqs.wmflabs.org
3 wikidataconcepts.wmflabs.org
4 citolytics-demo.wmflabs.org
4 drmf2016.wmflabs.org
4 elastic-wikidata.wmflabs.org
4 fab.wmflabs.org
4 incubator-dev.wmflabs.org
4 kibana4.wmflabs.org
4 ldfclient.wmflabs.org
4 mlebtesting-stable.wmflabs.org
4 mwfileimport.wmflabs.org
4 orbeon-bb.wmflabs.org
5 dls-espeakbox.wmflabs.org
5 flow-reportcard-test.wmflabs.org
5 gerrit-test.wmflabs.org
5 incubator.wmflabs.org
5 mlebtesting-master.wmflabs.org
5 recommend-missing-sections.wmflabs.org
5 wmde-wikidiff2-unpatched.wmflabs.org
6 catgraph-proxy-test.wmflabs.org
6 citolytics-de.wmflabs.org
6 dashboardchat-dev.wmflabs.org
6 deb-tools.wmflabs.org
6 drmf16-tc.wmflabs.org
6 dumps-2.wmflabs.org
6 language-reportcard.wmflabs.org
6 rm-cac.wmflabs.org
6 tools-static-beta.wmflabs.org
6 tools-static.wmflabs.org
6 wam.wmflabs.org
6 wikimania2017.wmflabs.org
7 cxserver-beta.wmflabs.org
7 ores-misc.wmflabs.org
8 design-research-methods.wmflabs.org
8 ores-staging.wmflabs.org
8 readinglists.wmflabs.org
8 wikiedu-dashboard-staging.wmflabs.org
8 wmde-wikidiff2-patched.wmflabs.org
9 items-repo.wmflabs.org
9 queryr.wmflabs.org
10 cloud.wmflabs.org
10 living-style-guide.wmflabs.org
10 wikidata-topicmaps.wmflabs.org
11 cx2.wmflabs.org
11 graphite.wmflabs.org
11 ja-wp-kuromoji-relforge.wmflabs.org
12 citolytics-simple.wmflabs.org
12 restbase-beta.wmflabs.org
13 graphoid-beta.wmflabs.org
13 metrics-staging.wmflabs.org
13 redis-dispatching-client.wmflabs.org
13 status.wmflabs.org
13 wikibase-vue.wmflabs.org
15 federated-wikidata.wmflabs.org
16 drmf-data.wmflabs.org
16 flow-reportcard.wmflabs.org
16 newsletter-test.wmflabs.org
17 phabzilla.wmflabs.org
18 citoid-beta.wmflabs.org
18 login-reading-web-staging-3.wmflabs.org
18 vital-signs.wmflabs.org
18 vmext-demo.wmflabs.org
19 browser-reports.wmflabs.org
19 visualeditor-test.wmflabs.org
20 wdqs-test.wmflabs.org
23 tools-beta-01.wmflabs.org
25 wikipedia.wmflabs.org
26 federated-commons.wmflabs.org
26 tofawiki.wmflabs.org
27 apertium.wmflabs.org
27 cxserver2.wmflabs.org
27 page-creation.wmflabs.org
27 pdfrender-beta.wmflabs.org
27 swserver.wmflabs.org
28 bugs.wmflabs.org
28 gerrit-icinga.wmflabs.org
30 sentry-beta.wmflabs.org
37 puppet-compiler-tools.wmflabs.org
41 analytics-prototype.wmflabs.org
44 vmext.wmflabs.org
46 discernatron.wmflabs.org
46 gerrit-new.wmflabs.org
48 livingstyleguide.wmflabs.org
50 tools-prometheus.wmflabs.org
50 xenon.wmflabs.org
52 ru-cirrus-browser-bot.wmflabs.org
52 visualeditor-realtime.wmflabs.org
55 discovery-beta.wmflabs.org
65 datavis.wmflabs.org
68 rcstream.wmflabs.org
70 mathoid-beta.wmflabs.org
74 labels-staging.wmflabs.org
74 www.wmflabs.org
76 vrt.wmflabs.org
77 accounts-dev.wmflabs.org
81 phab.wmflabs.org
94 wikidata-constraints.wmflabs.org
100 snuggle-en.wmflabs.org
105 structured-commons.wmflabs.org
109 wikispeech-tts-lexicon.wmflabs.org
119 edit-analysis.wmflabs.org
127 phab-01.wmflabs.org
131 librarybase.wmflabs.org
133 drmf-beta.wmflabs.org
135 huggle-wl.wmflabs.org
136 fastcci.wmflabs.org
137 mwv-apt.wmflabs.org
137 wpx.wmflabs.org
139 cx-testing.wmflabs.org
139 scholarships.wmflabs.org
142 gerrit-jenkins.wmflabs.org
149 commons-cirrus-browser-bot.wmflabs.org
149 googlevision-api-proxy.wmflabs.org
154 flow-tests.wmflabs.org
158 twlight-staging.wmflabs.org
164 wigi.wmflabs.org
169 wikispeech.wmflabs.org
174 phlogiston-dev.wmflabs.org
178 reportcard.wmflabs.org
191 wdcm.wmflabs.org
208 media-streaming.wmflabs.org
241 blacktea.wmflabs.org
261 proxy-eqiad.wmflabs.org
264 osmit3.wmflabs.org
265 recommend-related-articles.wmflabs.org
287 tin.wmflabs.org
287 tools-checker-via-proxy.wmflabs.org
312 arbcom-de.wmflabs.org
325 discourse.wmflabs.org
325 shinken.wmflabs.org
354 phragile.wmflabs.org
391 mol.wmflabs.org
413 wmflabs.org.wmflabs.org
421 intense.wmflabs.org
421 reading-web-staging.wmflabs.org
432 social-tools.wmflabs.org
438 whgi.wmflabs.org
440 logstash-beta.wmflabs.org
454 wikimaniablog.wmflabs.org
462 android-builds.wmflabs.org
517 puppet-compiler-other.wmflabs.org
521 reading-web-research.wmflabs.org
546 fastcci2.wmflabs.org
553 ogvjs-testing.wmflabs.org
581 discovery.wmflabs.org
586 appservice.wmflabs.org
599 fastcci3.wmflabs.org
620 cac.wmflabs.org
628 gouldi.wmflabs.org
686 fastcci1.wmflabs.org
702 wikispeech-tts.wmflabs.org
723 xtools-dev.wmflabs.org
788 commtech.wmflabs.org
808 metrics.wmflabs.org
921 wikipedialibrary.wmflabs.org
941 utrs.wmflabs.org
967 wdq.wmflabs.org
1002 phlogiston.wmflabs.org
1055 testme.wmflabs.org
1274 extdist.wmflabs.org
1420 centralauthtest-cac.wmflabs.org
1422 de-cac.wmflabs.org
1422 st-cac.wmflabs.org
1422 test-cac.wmflabs.org
1422 vote-cac.wmflabs.org
1423 en-cac.wmflabs.org
1440 ksh-cac.wmflabs.org
1443 recommend.wmflabs.org
1462 login-cac.wmflabs.org
1835 osmit-tm.wmflabs.org
1876 swis.wmflabs.org
1907 nomad.wmflabs.org
1960 mlebtesting.wmflabs.org
1994 commonsarchive.wmflabs.org
2110 etytree-virtuoso.wmflabs.org
2147 rcm-2.wmflabs.org
2293 ores-beta.wmflabs.org
2308 osm-estratti.wmflabs.org
2331 bots.wmflabs.org
2677 wikikids.wmflabs.org
2695 paws-public.wmflabs.org
2862 beta-prometheus.wmflabs.org
2963 google-api-proxy.wmflabs.org
3182 parsoid-beta.wmflabs.org
3678 accounts.wmflabs.org
3923 paws.wmflabs.org
4061 warper.wmflabs.org
4594 trending.wmflabs.org
4645 wikidata-lexeme.wmflabs.org
5342 cvn.wmflabs.org
6024 puppet-compiler.wmflabs.org
7580 wikistats.wmflabs.org
7713 cirrustest-cirrus-browser-bot.wmflabs.org
7743 outreachdashboard.wmflabs.org
17738 ids-testing.wmflabs.org
18065 petscan.wmflabs.org
22277 labels.wmflabs.org
30579 quarry.wmflabs.org
30873 marvin.wmflabs.org
33112 wm-bot.wmflabs.org
37920 ores.wmflabs.org
41029 wikistream.wmflabs.org
50223 swproxy.wmflabs.org
75015 mediawiki2latex.wmflabs.org
81641 xtools.wmflabs.org
90768 gitlab.wmflabs.org
216627 swproxy-mobile.wmflabs.org
934251 wma.wmflabs.org
8779046 tiles.wmflabs.org

Event Timeline

bd808 created this paste.Dec 1 2017, 4:51 AM
bd808 added a comment.Dec 1 2017, 5:05 AM

Major take away for me is that the tile server gets a LOT of traffic for a lot of different tiles.

# grep tiles.wmflabs.org access.log.1 | cut -d '"' -f 2 | awk '{print $2}' | sort | uniq | wc -l
5318639
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits