I have 1GB+ of jsonlines extracted by the tool and I have to search through them using an index
Description
Event Timeline
@Kiailandi the credentials should be in the Tools home at /data/project/strephit/.elasticsearch.ini
Mentioned in SAL (#wikimedia-cloud) [2017-10-18T14:04:17Z] <chasemp> add strephit creds to elasticsearch per T178310
Sorry to bother you, I always get a 401 when I try to use my credentials, both via curl and elasticsearch-py.
This is the output of curl -v
Hostname was NOT found in DNS cache
Trying 10.68.20.9...
Connected to tools-elastic-01.tools.eqiad.wmflabs (10.68.20.9) port 80 (#0)
Server auth using Basic with user 'strephit'
POST / HTTP/1.1
Authorization: Basic base64 name:password
User-Agent: curl/7.35.0
Host: tools-elastic-01.tools.eqiad.wmflabs
Accept: */*HTTP/1.1 401 Unauthorized
Server nginx/1.9.4 is not blacklisted
Server: nginx/1.9.4
Date: Mon, 06 Nov 2017 16:03:47 GMT
Content-Type: text/html
Content-Length: 194
Connection: keep-alive
Authentication problem. Ignoring this.
WWW-Authenticate: Basic realm="Elasticsearch protected actions"<html>
<head><title>401 Authorization Required</title></head>
<body bgcolor="white">
<center><h1>401 Authorization Required</h1></center>
<hr><center>nginx/1.9.4</center>
</body>
</html>
Connection #0 to host tools-elastic-01.tools.eqiad.wmflabs left intact
Could this be a problem related to my tool account?
Thank you.
The contents of your $HOME/.elasticsearch.ini were not quite right. The username should be "tools.strephit". I have fixed the config file for you.
I accidentally found a similar file, which I have deleted, to contain the password. I copied my session to P6724 (the first ll was me doing tab-completion) and set non-public paste. @Kiailandi Shall we generate a new one?