Page MenuHomePhabricator

IPv6 SSH to gerrit.wikimedia.org hangs (blackhole route?)
Closed, ResolvedPublicBUG REPORT

Description

Started following T326368: gerrit1003 service implementation task:

$ ssh -4 bd808@gerrit.wikimedia.org -p 29418

  ****    Welcome to Gerrit Code Review    ****

  Hi BryanDavis, you have successfully connected over SSH.

  Unfortunately, interactive shells are disabled.
  To clone a hosted Git repository, use:

  git clone ssh://bd808@gerrit.wikimedia.org:29418/REPOSITORY_NAME.git

Connection to gerrit.wikimedia.org closed.
$ ssh -v -6 bd808@gerrit.wikimedia.org -p 29418
OpenSSH_9.3p1, OpenSSL 1.1.1t  7 Feb 2023
debug1: Reading configuration data /Users/bd808/.ssh/config
debug1: /Users/bd808/.ssh/config line 88: Applying options for gerrit.wikimedia.org
debug1: /Users/bd808/.ssh/config line 115: Skipping Host block because of negated match for gerrit.wikimedia.org
debug1: /Users/bd808/.ssh/config line 123: Skipping Host block because of negated match for gerrit.wikimedia.org
debug1: /Users/bd808/.ssh/config line 128: Applying options for *
debug1: Reading configuration data /usr/local/etc/ssh/ssh_config
debug1: auto-mux: Trying existing master
debug1: Control socket "/Users/bd808/.ssh/sockets/ab28dff4d65d2c92d57ac0a0f837c84a6fc42cc6" does not exist
debug1: Connecting to gerrit.wikimedia.org [2620:0:861:2:208:80:154:151] port 29418.

Current workaround: add AddressFamily inet to the Host gerrit gerrit.wikimedia.org block in my $HOME/.ssh/config.

Event Timeline

Change 919161 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] gerrit: fix gerrit1003 ipv6 address

https://gerrit.wikimedia.org/r/919161

Change 919161 merged by Ssingh:

[operations/puppet@production] gerrit: fix gerrit1003 ipv6 address

https://gerrit.wikimedia.org/r/919161

bd808 assigned this task to hashar.
$ ssh -6 bd808@gerrit.wikimedia.org -p 29418

  ****    Welcome to Gerrit Code Review    ****

  Hi BryanDavis, you have successfully connected over SSH.

  Unfortunately, interactive shells are disabled.
  To clone a hosted Git repository, use:

  git clone ssh://bd808@gerrit.wikimedia.org:29418/REPOSITORY_NAME.git

Connection to gerrit.wikimedia.org closed.

I have removed the faulty IPv6 from /etc/network/interfaces and manually removed it with:

ip addr del 2620:0:861:2:208:80:154:51/128 dev eno8303

Mentioned in SAL (#wikimedia-operations) [2023-05-11T16:50:25Z] <hashar> CI / Zuul was slow to report build results back to Gerrit most probably due to lack of IPv6 (T336524) which should be solved now.