Page MenuHomePhabricator

Igorkim78 (Igor Kim)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Sunday

  • Clear sailing ahead.

User Details

User Since
Apr 2 2019, 6:24 PM (24 w, 3 d)
Availability
Available
LDAP User
Unknown
MediaWiki User
Igorkim78 [ Global Accounts ]

Recent Activity

Thu, Sep 12

Igorkim78 created T232768: Branching factors configuration for Blazegraph instances.
Thu, Sep 12, 6:24 PM · WDQS-Optimizer
Igorkim78 created T232739: Requesting access to wmcs beta cluster for igorkim78.
Thu, Sep 12, 1:00 PM · Beta-Cluster-Infrastructure, Release-Engineering-Team

Thu, Aug 29

Igorkim78 added a comment to T231411: Test new Updater service.

Differences in bnodes might be tolerated with additional replacement. The cleanup stage could be merged with initial sed+sort

Thu, Aug 29, 6:46 AM · Discovery-Wikidata-Query-Service-Sprint, Performance, Wikidata-Query-Service, Wikidata

Aug 2 2019

Igorkim78 added a comment to T229655: bad interaction of lang() with wikibase:label.

Looking at query exetution plans, ProjectionOp for the query with lang() for coDescription got arranged prior to materialization of coDescription, so it (along with its lang) has not got the way to the projection. The reason for such behavior needs some more research. Will update on that.

Aug 2 2019, 7:20 PM · Wikidata, Wikidata-Query-Service

Jul 1 2019

Igorkim78 added a comment to T175840: Using label service twice in one query results in obscure error message.

Fixed optional support and added testcase for that code path.
Service projectedVars actually include both inbound and outbound variables (those which are params for the service and those which are produced by labels lookup. But for the check if service node could be reordered prior to any clauses placed at the bottom of the query, we need to consider only inbound variables, so they would be available for the service call, and all outbound vars available for the latter filters and other clauses.

Jul 1 2019, 3:46 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Discovery, Wikidata

Jun 25 2019

Igorkim78 added a comment to T175840: Using label service twice in one query results in obscure error message.

The idea for the change is to replace runLast hint with more complicated logic. So there are 3 steps:

  • first 'most probable optimal' placement to allow for EmptyLabelServiceOptimizer to see the variables to process.
  • then EmptyLabelServiceOptimizer adds statement patterns for resolutions.
  • and then additional optimizer step rearranges LabelService to the latest possible step before any clauses, which might use the variables bound by LabelService.
Jun 25 2019, 9:05 PM · Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Discovery, Wikidata

May 7 2019

Igorkim78 added a comment to T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected.

The EmptyLabelServiceOptimizer running optimizeJoinGroup(AST2BOpContext, StaticAnalysis, IBindingSet[], JoinGroupNode) as of current takes projection from StaticAnalisys.getQueryRoot() as parent of JoinGroupNode wrapping statement pattern of the LabelService clause is unavailable.

May 7 2019, 9:35 PM · Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Upstream, Discovery, Wikidata, Wikidata-Query-Service

May 6 2019

Igorkim78 added a comment to T213375: Inline value and reference URIs.

Additionally tested configuration option with only Raw records disabled, comparing to original baseline:

May 6 2019, 4:49 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Igorkim78 added a comment to T213375: Inline value and reference URIs.

Configuration options are assigned in RWStore.properties. Particular options are:

May 6 2019, 4:43 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Igorkim78 added a comment to T153353: Blazegraph not properly using labels from sub-queries for filtering (omitting rows), unless they're selected.

This seems to be optimizers order problem.
CompareBOp executes to check if "Ada"@en equals to ?langLabel several times but the ?langLabel is not bound on all occasions:
while running ASTDeferredIVResolution
while running com.bigdata.rdf.sparql.ast.optimizers.ASTSetValueExpressionsOptimizer
then while running ConditionalRoutingOp for ChunkedRunningQuery

May 6 2019, 4:36 PM · Discovery-Wikidata-Query-Service-Sprint, User-Smalyshev, Upstream, Discovery, Wikidata, Wikidata-Query-Service

Apr 29 2019

Igorkim78 added a comment to T213375: Inline value and reference URIs.

Complete test logs attached

Apr 29 2019, 5:00 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Igorkim78 added a comment to T213375: Inline value and reference URIs.

Load performance for the tested configurations on isolated environment (i7-7700HQ, 8 cores 2.8GHz, 32GB RAM, SSD Samsung 960 PRO)

Apr 29 2019, 4:50 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata
Igorkim78 added a comment to T213375: Inline value and reference URIs.

Attached results of the load 100 ttl.gz files with different configurations

Apr 29 2019, 4:41 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata

Apr 22 2019

Igorkim78 claimed T213375: Inline value and reference URIs.

Changeset created to support reference URIs inlining:
https://gerrit.wikimedia.org/r/#/c/wikidata/query/blazegraph/+/505642

Apr 22 2019, 4:55 PM · Patch-For-Review, Discovery-Wikidata-Query-Service-Sprint, Wikidata-Query-Service, Wikidata