Page MenuHomePhabricator
Feed Advanced Search

Feb 7 2015

Fceller added a comment to T88549: Investigate ArangoDB for Wikidata Query.

Maybe we can take a step back and ignore the ArangoDB specifics for the moment. I'm also organising NoSQL conferences and consulting NoSQL in general.

Feb 7 2015, 1:52 PM · MediaWiki-Core-Team, Wikidata-Query-Service

Feb 5 2015

Fceller added a comment to T88549: Investigate ArangoDB for Wikidata Query.

There are thousands of indexable attributes, but not each document has every one of them - typical one would have tens, rarely up to a hundred. We need to be able to search by any of the attributes though.

I see. That could be the root cause of the problem. The test dataset that you used, did it contain a lot of documents with unset attributes for the hash-index? Currently we do not support sparse indexes - but my colleague has started enhanced to allow them. I'll check with him.

Feb 5 2015, 8:02 PM · MediaWiki-Core-Team, Wikidata-Query-Service
Fceller added a comment to T88549: Investigate ArangoDB for Wikidata Query.

There are thousands of indexable attributes, but not each document has every one of them - typical one would have tens, rarely up to a hundred. We need to be able to search by any of the attributes though.

Feb 5 2015, 6:14 PM · MediaWiki-Core-Team, Wikidata-Query-Service
Fceller added a comment to T88549: Investigate ArangoDB for Wikidata Query.

@Smalyshev May I ask how much main memory your server has?

Feb 5 2015, 5:57 PM · MediaWiki-Core-Team, Wikidata-Query-Service
Fceller added a comment to T88549: Investigate ArangoDB for Wikidata Query.

Hi, I'm the CTO of ArangoDB, so my comments are most certainly biased. I still would like to tell you about our opinions on the raised issues, namely full-text indexes and blueprint.

Feb 5 2015, 4:29 PM · MediaWiki-Core-Team, Wikidata-Query-Service