Page MenuHomePhabricator

ssingh (Sukhbir Singh)
OK Computer

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Dec 11 2018, 9:39 PM (136 w, 3 d)
Availability
Available
IRC Nick
sukhe
LDAP User
Unknown
MediaWiki User
SSingh (WMF) [ Global Accounts ]

SRE/Traffic

Recent Activity

Yesterday

ssingh triaged T287266: Unexpected auditd service restart failure as Low priority.
Fri, Jul 23, 5:07 PM · SRE, Traffic
ssingh created T287266: Unexpected auditd service restart failure.
Fri, Jul 23, 4:41 PM · SRE, Traffic

Mon, Jul 19

ssingh committed rOHPUbc7ec5ee1e0a: Remove malmok.wikimedia.org from anycast_neighbors in codfw (authored by ssingh).
Remove malmok.wikimedia.org from anycast_neighbors in codfw
Mon, Jul 19, 3:09 PM

Tue, Jul 13

ssingh committed rOSKW6155fdfe824c: test_dns: improve the EDNS client subnet tests (authored by ssingh).
test_dns: improve the EDNS client subnet tests
Tue, Jul 13, 4:09 PM
ssingh updated the task description for T286065: Switch buffer re-partition - Eqiad Row C.
Tue, Jul 13, 1:06 PM · DBA, Analytics, Infrastructure-Foundations, SRE, netops
ssingh updated the task description for T286069: Switch buffer re-partition - Eqiad Row D.
Tue, Jul 13, 1:03 PM · Patch-For-Review, DBA, Analytics, cloud-services-team (Kanban), Infrastructure-Foundations, SRE, netops

Mon, Jul 12

ssingh created T286480: Decomission malmok.wikimedia.org.
Mon, Jul 12, 1:57 PM · SRE, Traffic

Jun 22 2021

ssingh committed rOSKWa334c4e07202: test_dns: update test to reflect anycasted Wikidough service (authored by ssingh).
test_dns: update test to reflect anycasted Wikidough service
Jun 22 2021, 8:23 PM

Jun 18 2021

ssingh added a comment to T285091: Access to ptwikinews Search Console for Edu.

Hi all. I have brought this up and are discussing this internally in SRE. I will update the ticket when I have more information. Thank you.

Jun 18 2021, 5:51 PM · SRE, SRE-Access-Requests
ssingh closed T285126: Replace production ssh keys for jgiannelos as Resolved.

@Jgiannelos: Thanks for the additional confirmation; the SSH key has been updated. Marking this as resolved, please feel free to reopen if there are any issues.

Jun 18 2021, 12:34 PM · SRE-Access-Requests, SRE

Jun 17 2021

ssingh claimed T285091: Access to ptwikinews Search Console for Edu.
Jun 17 2021, 2:28 PM · SRE, SRE-Access-Requests

Jun 15 2021

ssingh triaged T284996: Special:Contributions times out when target expressed in CIDR notation as High priority.
Jun 15 2021, 2:54 PM · Performance Issue, MediaWiki-Special-pages
ssingh closed T284987: re-open access to Analytic Cluster for ChristineDeKock as Resolved.

Hi @ssingh. Thank you for your trouble. I have signed the L3 form.

Jun 15 2021, 2:41 PM · SRE, SRE-Access-Requests
ssingh updated the task description for T284987: re-open access to Analytic Cluster for ChristineDeKock.
Jun 15 2021, 2:31 PM · SRE, SRE-Access-Requests
ssingh added a comment to T284987: re-open access to Analytic Cluster for ChristineDeKock.

Hi @ChristineDeKock: Can you please read through and sign the L3 (Acknowledgement of Wikimedia Server Access Responsibilities) document? Thank you!

Jun 15 2021, 1:50 PM · SRE, SRE-Access-Requests
ssingh updated the task description for T284987: re-open access to Analytic Cluster for ChristineDeKock.
Jun 15 2021, 1:48 PM · SRE, SRE-Access-Requests
ssingh closed T281344: SRE Onboarding for Marc Mandere as Resolved.

Marc has been added to VictorOps and the SRE team; resolving this task. Thanks, all.

Jun 15 2021, 1:03 PM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Jun 15 2021, 1:02 PM · SRE, SRE-Access-Requests

Jun 14 2021

ssingh closed T284773: Requesting access to mwmaint1002 for mepps as Resolved.

@mepps: You have been added to the restricted group. Please let us know if there are any questions, thanks!

Jun 14 2021, 7:49 PM · SRE, SRE-Access-Requests
ssingh added a comment to T281344: SRE Onboarding for Marc Mandere.

Anything still pending here on the SRE-Access-Requests side?

Thanks for checking! I updated pwstore as that was completed; I am not sure about the remaining item so I will let @MMandere comment and we can work towards completing that.

Jun 14 2021, 6:45 PM · SRE, SRE-Access-Requests
ssingh updated the task description for T284773: Requesting access to mwmaint1002 for mepps.
Jun 14 2021, 4:00 PM · SRE, SRE-Access-Requests

Jun 10 2021

ssingh closed T283503: Please configure the routers for Wikidough's anycasted IP as Resolved.

Marking this as resolved as we have completed all the intended tasks for now and the routers have been configured.

Jun 10 2021, 3:56 PM · SRE, netops, Traffic
ssingh closed T283503: Please configure the routers for Wikidough's anycasted IP, a subtask of T283027: Offer Wikidough as an anycasted service, as Resolved.
Jun 10 2021, 3:56 PM · SRE, Traffic
ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

Additional confirmation, since I am enjoying the reduced latency of the new Toronto -> eqiad route instead of the old Toronto -> codfw :)

Jun 10 2021, 2:37 PM · SRE, netops, Traffic
ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

INFO:homer.transports.junos:Committing the configuration on cr2-eqiad.wikimedia.org
INFO:homer:Homer run completed successfully on 2 devices: ['cr1-eqiad.wikimedia.org', 'cr2-eqiad.wikimedia.org']

Jun 10 2021, 2:32 PM · SRE, netops, Traffic
ssingh committed rOHPUb1f013210378: Add doh1001 and doh1002 to BGP anycast in eqiad (authored by ssingh).
Add doh1001 and doh1002 to BGP anycast in eqiad
Jun 10 2021, 2:28 PM
ssingh closed T284348: Please create two Ganeti VMs for Wikidough in eqiad as Resolved.

doh1001 and doh1002 have been created; closing this task. Thanks for the help!

Jun 10 2021, 2:26 PM · Patch-For-Review, SRE, Traffic, vm-requests
ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

INFO:homer.transports.junos:Committing the configuration on cr4-ulsfo.wikimedia.org
INFO:homer:Homer run completed successfully on 2 devices: ['cr3-ulsfo.wikimedia.org', 'cr4-ulsfo.wikimedia.org']

Jun 10 2021, 1:36 PM · SRE, netops, Traffic
ssingh committed rOHPU27935eb46397: Add doh4001 to BGP anycast in ulsfo (authored by ssingh).
Add doh4001 to BGP anycast in ulsfo
Jun 10 2021, 1:34 PM

Jun 8 2021

ssingh added a comment to T284349: Please create a Ganeti VM for Wikidough in ulsfo.

Cookbook ran successfully. Currently unprovisioned.

Jun 8 2021, 9:14 PM · SRE, Traffic, vm-requests

Jun 7 2021

ssingh added a comment to T281344: SRE Onboarding for Marc Mandere.

Anything still pending here on the SRE-Access-Requests side?

Jun 7 2021, 8:27 PM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Jun 7 2021, 8:24 PM · SRE, SRE-Access-Requests

Jun 4 2021

ssingh renamed T284349: Please create a Ganeti VM for Wikidough in ulsfo from Please create two Ganeti VMs for Wikidough in ulsfo to Please create a Ganeti VM for Wikidough in ulsfo.
Jun 4 2021, 7:29 PM · SRE, Traffic, vm-requests
ssingh created T284349: Please create a Ganeti VM for Wikidough in ulsfo.
Jun 4 2021, 7:24 PM · SRE, Traffic, vm-requests
ssingh created T284348: Please create two Ganeti VMs for Wikidough in eqiad.
Jun 4 2021, 7:24 PM · Patch-For-Review, SRE, Traffic, vm-requests
ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

doh5001 is also up; from Mumbai, we are reaching eqsin as desired:

Jun 4 2021, 11:30 AM · SRE, netops, Traffic
ssingh committed rOHPU6f7b4ee23d04: Add doh5001 to BGP anycast in eqsin (authored by ssingh).
Add doh5001 to BGP anycast in eqsin
Jun 4 2021, 10:31 AM
ssingh updated subscribers of T284246: Please create two Ganeti VMs for Wikidough in eqsin.

@ssingh doh5001.wikimedia.org is ready for you now. doh5002 on hold for lack of IP in that subnet.

Jun 4 2021, 2:16 AM · SRE, Traffic, vm-requests

Jun 3 2021

ssingh updated the task description for T284246: Please create two Ganeti VMs for Wikidough in eqsin.
Jun 3 2021, 6:15 PM · SRE, Traffic, vm-requests
ssingh created T284246: Please create two Ganeti VMs for Wikidough in eqsin.
Jun 3 2021, 6:09 PM · SRE, Traffic, vm-requests
ssingh added a comment to T283852: Please create two Ganeti VMs for Wikidough in esams.

Thanks for all the help and sorry it took a while! I think 10G should be fine for now given the current usage on the other Wikidough hosts.

Jun 3 2021, 1:59 AM · SRE, Traffic, vm-requests

Jun 2 2021

ssingh added a comment to T275696: decommission cescout1001.eqiad.wmnet.

Puppet roles/profiles/hiera configurations have not been removed as they will be needed for the cescout VM that will be provisioned later.

Jun 2 2021, 4:30 PM · SRE, Traffic, decommission-hardware

May 27 2021

ssingh renamed T283852: Please create two Ganeti VMs for Wikidough in esams from Please create two Ganeti VMs for Wikidough to Please create two Ganeti VMs for Wikidough in esams.
May 27 2021, 6:44 PM · SRE, Traffic, vm-requests
ssingh triaged T283852: Please create two Ganeti VMs for Wikidough in esams as Medium priority.
May 27 2021, 6:28 PM · SRE, Traffic, vm-requests
ssingh created T283852: Please create two Ganeti VMs for Wikidough in esams.
May 27 2021, 6:27 PM · SRE, Traffic, vm-requests

May 26 2021

ssingh updated the task description for T283027: Offer Wikidough as an anycasted service.
May 26 2021, 5:37 PM · SRE, Traffic
ssingh added a comment to T283614: RIPE Atlas monitoring of reachability & latency towards anycasted Wikidough IP.

This service is now live in codfw, answering DoH, DoT and plain-old DNS.

I believe dnsdist is terminating the DoH/DoT, but regular queries on UDP/TCP 53 go directly to Power DNS Recursor. No problem with that, but worth noting we only get something back for NSID when we talk to dnsdist, and I assume with the Atlas probes we can only make regular queries.

root@debiantest:~# dig +nsid +https www.ietf.org @wikimedia-dns.org

; <<>> DiG 9.17.13-2+0~20210520.56+debian11~1.gbp96c80e-Debian <<>> +nsid +https www.ietf.org @wikimedia-dns.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 39806
;; flags: qr rd ra ad; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
; NSID: 6d 61 6c 6d 6f 6b ("malmok")
;; QUESTION SECTION:
;www.ietf.org.			IN	A

;; ANSWER SECTION:
www.ietf.org.		944	IN	CNAME	www.ietf.org.cdn.cloudflare.net.
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.44.99
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.45.99

;; Query time: 159 msec
;; SERVER: 185.71.138.138#443(wikimedia-dns.org) (HTTPS)
;; WHEN: Wed May 26 18:11:11 BST 2021
;; MSG SIZE  rcvd: 128
root@debiantest:~# dig +nsid +tls www.ietf.org @wikimedia-dns.org

; <<>> DiG 9.17.13-2+0~20210520.56+debian11~1.gbp96c80e-Debian <<>> +nsid +tls www.ietf.org @wikimedia-dns.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 50986
;; flags: qr rd ra ad; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
; NSID: 6d 61 6c 6d 6f 6b ("malmok")
;; QUESTION SECTION:
;www.ietf.org.			IN	A

;; ANSWER SECTION:
www.ietf.org.		275	IN	CNAME	www.ietf.org.cdn.cloudflare.net.
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.44.99
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.45.99

;; Query time: 348 msec
;; SERVER: 185.71.138.138#853(wikimedia-dns.org) (TLS)
;; WHEN: Wed May 26 18:22:20 BST 2021
;; MSG SIZE  rcvd: 128
root@debiantest:~# dig +nsid www.ietf.org @wikimedia-dns.org

; <<>> DiG 9.17.13-2+0~20210520.56+debian11~1.gbp96c80e-Debian <<>> +nsid www.ietf.org @wikimedia-dns.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 35293
;; flags: qr rd ra ad; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 1220
; COOKIE: bd8627f07957ae320100000060ae81eb55bd3b21e9c23314 (good)
;; QUESTION SECTION:
;www.ietf.org.			IN	A

;; ANSWER SECTION:
www.ietf.org.		1800	IN	CNAME	www.ietf.org.cdn.cloudflare.net.
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.44.99
www.ietf.org.cdn.cloudflare.net. 300 IN	A	104.16.45.99

;; Query time: 2467 msec
;; SERVER: 185.71.138.138#53(wikimedia-dns.org) (UDP)
;; WHEN: Wed May 26 18:14:19 BST 2021
;; MSG SIZE  rcvd: 146
May 26 2021, 5:34 PM · Traffic
ssingh committed rOSKWd371186bf320: Update tests for the new Wikidough host and IP (authored by ssingh).
Update tests for the new Wikidough host and IP
May 26 2021, 4:54 PM
ssingh updated the task description for T283027: Offer Wikidough as an anycasted service.
May 26 2021, 4:53 PM · SRE, Traffic

May 24 2021

ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

I spoke with Arzhel about it and he's pointed me in the right direction.

I think your change is good to merge, however we don't want to have a huge time gap between merging it and the one for the network side.

I will prepare that and if Arzhel is happy with it we can merge first your one, to add Bird to the VMs, and then shortly after the one I am creating which will cover the network side.

Cathal.

May 24 2021, 4:59 PM · SRE, netops, Traffic
ssingh added a comment to T283503: Please configure the routers for Wikidough's anycasted IP.

Hey Sukhbir,

Can you confirm "doh2001" and "doh2002" are the VMs which will Anycast the Wikidough IP?

May 24 2021, 4:15 PM · SRE, netops, Traffic
ssingh committed rOSKW82c697bc6cee: test_tls: add a test for checking the certificates (authored by ssingh).
test_tls: add a test for checking the certificates
May 24 2021, 3:37 PM
ssingh added a subtask for T283027: Offer Wikidough as an anycasted service: T283503: Please configure the routers for Wikidough's anycasted IP.
May 24 2021, 1:48 PM · SRE, Traffic
ssingh added a parent task for T283503: Please configure the routers for Wikidough's anycasted IP: T283027: Offer Wikidough as an anycasted service.
May 24 2021, 1:48 PM · SRE, netops, Traffic
ssingh created T283503: Please configure the routers for Wikidough's anycasted IP.
May 24 2021, 1:37 PM · SRE, netops, Traffic

May 21 2021

ssingh updated the task description for T283027: Offer Wikidough as an anycasted service.
May 21 2021, 2:12 PM · SRE, Traffic

May 20 2021

ssingh updated the task description for T283027: Offer Wikidough as an anycasted service.
May 20 2021, 7:42 PM · SRE, Traffic
ssingh added a comment to T283192: Please create two Ganeti VMs for Wikidough.

VMs have been created, added to site.pp with "insetup", added to DHCP and partma.

OS has been installed (buster) and puppet certs signed. You can now SSH to them.

May 20 2021, 11:31 AM · SRE, Traffic, vm-requests

May 19 2021

ssingh added a comment to T283192: Please create two Ganeti VMs for Wikidough.
May 19 2021, 10:23 PM · SRE, Traffic, vm-requests
ssingh updated the task description for T283192: Please create two Ganeti VMs for Wikidough.
May 19 2021, 5:50 PM · SRE, Traffic, vm-requests
ssingh created T283192: Please create two Ganeti VMs for Wikidough.
May 19 2021, 5:49 PM · SRE, Traffic, vm-requests

May 18 2021

ssingh updated the task description for T283027: Offer Wikidough as an anycasted service.
May 18 2021, 6:58 PM · SRE, Traffic

May 17 2021

ssingh added a subtask for T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver: T283027: Offer Wikidough as an anycasted service.
May 17 2021, 6:38 PM · Patch-For-Review, SRE, Traffic
ssingh added a parent task for T283027: Offer Wikidough as an anycasted service: T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver.
May 17 2021, 6:37 PM · SRE, Traffic
ssingh created T283027: Offer Wikidough as an anycasted service.
May 17 2021, 6:37 PM · SRE, Traffic

May 11 2021

ssingh committed rOSKW19eaf031bb06: test_dns: improve identifier for DoH response (authored by ssingh).
test_dns: improve identifier for DoH response
May 11 2021, 4:39 PM
ssingh committed rOSKW46e46748d6dc: test_dns: add a test to check for DoH response headers (authored by ssingh).
test_dns: add a test to check for DoH response headers
May 11 2021, 4:34 PM

May 10 2021

ssingh added a comment to T275234: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org.

@ayounsi, @Aklapper: I forgot to update this ticket, apologies! Last I checked, all reports were in the green and there wasn't any debugging information. But since we have had no user updates and it's been a while since I looked, I will check again and update this ticket accordingly. Thanks!

May 10 2021, 7:21 PM · Infrastructure-Foundations, SRE, netops, Traffic

Apr 30 2021

ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Apr 30 2021, 11:44 AM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Apr 30 2021, 11:32 AM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Apr 30 2021, 11:16 AM · SRE, SRE-Access-Requests
ssingh added a comment to T281344: SRE Onboarding for Marc Mandere.

@MMandere: Added to "ops" LDAP group. https://wikitech.wikimedia.org/wiki/LDAP/Groups#ops_group

Apr 30 2021, 10:17 AM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Apr 30 2021, 10:17 AM · SRE, SRE-Access-Requests
ssingh updated the task description for T281344: SRE Onboarding for Marc Mandere.
Apr 30 2021, 9:49 AM · SRE, SRE-Access-Requests

Apr 27 2021

ssingh raised the priority of T275696: decommission cescout1001.eqiad.wmnet from Medium to High.
Apr 27 2021, 9:32 PM · SRE, Traffic, decommission-hardware

Apr 26 2021

ssingh committed rOSKW307b8e0d3284: Improve tests/test_dns.py [no code change] (authored by ssingh).
Improve tests/test_dns.py [no code change]
Apr 26 2021, 9:14 PM
ssingh updated the task description for T274431: Wikidough: Support EDNS(0) Padding: RFC 7830 and RFC 8467.
Apr 26 2021, 2:35 PM · SRE, Traffic

Mar 2 2021

ssingh added a comment to T274605: Top read is showing one page that had fake traffic in zhwiki.

Hi @JAllemandou: thanks, I think proceeding through Wikimedia Taiwan as @Shizhao mentioned is probably a good idea. In the meantime, I will ask for a contact in the community and also if the partnerships team has some idea (we have asked for their help in the recent past with a similar issue).

Mar 2 2021, 4:54 PM · Wikimedia Taiwan, Analytics, Chinese-Sites, Pageviews-Anomaly, Product-Infrastructure-Team-Backlog

Feb 24 2021

ssingh created T275696: decommission cescout1001.eqiad.wmnet.
Feb 24 2021, 9:04 PM · SRE, Traffic, decommission-hardware

Feb 22 2021

ssingh added a comment to T275234: TATA SKY Broadband (AS134674) issues with connecting to upload.wikimedia.org.

We decided to file https://github.com/citizenlab/test-lists/pull/730 so that we can get some test data.

Feb 22 2021, 8:02 PM · Infrastructure-Foundations, SRE, netops, Traffic
ssingh added a comment to T275409: Create and document Wikidough's privacy policy.

For reference, https://wiki.mozilla.org/Security/DOH-resolver-policy has links to the privacy policies of the Mozilla-approved resolvers.

Feb 22 2021, 7:46 PM · Privacy Engineering, SRE, Traffic
ssingh updated subscribers of T275409: Create and document Wikidough's privacy policy.
Feb 22 2021, 4:54 PM · Privacy Engineering, SRE, Traffic
ssingh added a subtask for T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver: T275409: Create and document Wikidough's privacy policy.
Feb 22 2021, 4:54 PM · Patch-For-Review, SRE, Traffic
ssingh added a parent task for T275409: Create and document Wikidough's privacy policy: T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver.
Feb 22 2021, 4:53 PM · Privacy Engineering, SRE, Traffic
ssingh created T275409: Create and document Wikidough's privacy policy.
Feb 22 2021, 4:53 PM · Privacy Engineering, SRE, Traffic

Feb 21 2021

ssingh updated ssingh.
Feb 21 2021, 4:48 PM
ssingh updated ssingh.
Feb 21 2021, 4:48 PM

Feb 16 2021

ssingh added a comment to T274914: Reducing logging levels when running a Hive query.

I edited the task but I wanted to add here as well that this happens when I run the Hive query from Spark.

Feb 16 2021, 7:20 PM · Analytics
ssingh added a comment to T274823: Big increase in traffic for projects except 'wikipedia' family since Feb 14th.

Thanks for opening this task, Marcel.

Feb 16 2021, 7:18 PM · Analytics-Radar, Product-Analytics (Kanban)
ssingh updated the task description for T274914: Reducing logging levels when running a Hive query.
Feb 16 2021, 6:53 PM · Analytics
ssingh created T274914: Reducing logging levels when running a Hive query.
Feb 16 2021, 5:43 PM · Analytics

Feb 10 2021

ssingh moved T274431: Wikidough: Support EDNS(0) Padding: RFC 7830 and RFC 8467 from Triage to DNS Infra on the Traffic board.
Feb 10 2021, 9:18 PM · SRE, Traffic
ssingh added a subtask for T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver: T274431: Wikidough: Support EDNS(0) Padding: RFC 7830 and RFC 8467.
Feb 10 2021, 9:14 PM · Patch-For-Review, SRE, Traffic
ssingh added a parent task for T274431: Wikidough: Support EDNS(0) Padding: RFC 7830 and RFC 8467: T252132: Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver.
Feb 10 2021, 9:14 PM · SRE, Traffic
ssingh created T274431: Wikidough: Support EDNS(0) Padding: RFC 7830 and RFC 8467.
Feb 10 2021, 9:13 PM · SRE, Traffic

Feb 9 2021

ssingh added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

Thank you for the interest in this task! Like we shared yesterday, we have identified that the traffic is coming from a popular mobile app in India. We have initiated contact with the app developers, and are waiting to hear back from them. In the meantime, given the volume of requests, we have decided to ban those specific requests until the issue is resolved. While we will refrain from naming the app at this time, we can share that it is not on the list of apps mentioned in this task. Nevertheless, we thank you for your comments and suggestions on how to debug this!

Feb 9 2021, 5:17 PM · Commons, Traffic, SRE
ssingh added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

Thank you everyone for the comments and suggestions. I just wanted to share that we have identified the app and will update this task tomorrow. (And yes, it is a mobile app.)

Feb 9 2021, 3:29 AM · Commons, Traffic, SRE

Feb 8 2021

ssingh added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

Could it be this app?

https://apps.apple.com/hk/app/iclass-corporate/id1439400748?l=en

The picture appears in a screenshot...

Feb 8 2021, 11:14 PM · Commons, Traffic, SRE
ssingh added a comment to T273741: Investigate unusual media traffic pattern for AsterNovi-belgii-flower-1mb.jpg on Commons.

I found several places where this URL is being used in sample code, which might have been picked up by somebody and built into an app:

https://stackoverflow.com/questions/18586466/foursqaure-photo-add-against-checkin
https://stackoverflow.com/questions/18232898/node-js-http-get-with-node-js-step-module
https://html.developreference.com/article/14455997/Downloading+image+from+the+web+with+imagemagick+and+saving+to+parse

seems like this particular flower has been kicking around as a sample image for quite a few years.

Feb 8 2021, 11:14 PM · Commons, Traffic, SRE

Feb 2 2021

ssingh triaged T273679: Wikidough: Upgrade to dnsdist 1.6.0 as Medium priority.
Feb 2 2021, 9:36 PM · SRE, Traffic