Page MenuHomePhabricator

pfischer (Peter Fischer)
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Sep 2 2022, 7:28 AM (97 w, 1 d)
Availability
Available
IRC Nick
pfischer
LDAP User
Peter Fischer
MediaWiki User
PFischer-WMF [ Global Accounts ]

Recent Activity

Thu, Jul 11

pfischer moved T369729: RDF Updater Consumer: Allow "empty" patches from In Progress to Needs review on the Discovery-Search (Current work) board.
Thu, Jul 11, 9:24 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
pfischer changed the status of T369729: RDF Updater Consumer: Allow "empty" patches from Open to In Progress.
Thu, Jul 11, 8:30 AM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata
pfischer changed the status of T369729: RDF Updater Consumer: Allow "empty" patches, a subtask of T337013: [Epic] Splitting the graph in WDQS, from Open to In Progress.
Thu, Jul 11, 8:28 AM · Discovery-Search (Current work), Epic, Wikidata-Query-Service, Wikidata

Wed, Jul 10

pfischer created T369729: RDF Updater Consumer: Allow "empty" patches.
Wed, Jul 10, 3:12 PM · Patch-For-Review, Discovery-Search (Current work), Wikidata-Query-Service, Wikidata

Tue, Jul 9

pfischer changed the status of T366340: SUP: Incorrect overall fetch timeout calculation from Open to In Progress.
Tue, Jul 9, 6:52 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T286814: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string from In Progress to Needs review on the Discovery-Search (Current work) board.
Tue, Jul 9, 6:48 PM · MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), Discovery-Search (Current work), Wikimedia-production-error, Data-Engineering
pfischer moved T361935: Adapt the WDQS Streaming Updater to update multiple WDQS subgraphs from In Progress to Needs review on the Discovery-Search (Current work) board.
Tue, Jul 9, 6:48 PM · Discovery-Search (Current work), Wikidata
pfischer added a comment to T286814: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string.

Alright, I might have found a way to reproduce it:

Tue, Jul 9, 9:18 AM · MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), Discovery-Search (Current work), Wikimedia-production-error, Data-Engineering
pfischer added a comment to T286814: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string.

I did a quick test run with the browser implied by the UA (Chrome 91 on Windows 10): https://www.browserling.com/browse/win10/chrome91/https://en.wikipedia.org. Entering text in the search input field resulted in correct events. Sadly, it's not clear on which page that happened.

Tue, Jul 9, 8:48 AM · MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), Discovery-Search (Current work), Wikimedia-production-error, Data-Engineering

Mon, Jul 8

pfischer moved T365158: Homogenise jackson version from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Mon, Jul 8, 3:21 PM · Discovery-Search (Current work), Wikidata
pfischer moved T365158: Homogenise jackson version from In Progress to Needs review on the Discovery-Search (Current work) board.
Mon, Jul 8, 3:21 PM · Discovery-Search (Current work), Wikidata
pfischer changed the status of T286814: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string from Open to In Progress.
Mon, Jul 8, 3:13 PM · MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), Discovery-Search (Current work), Wikimedia-production-error, Data-Engineering

Wed, Jul 3

pfischer created T369148: Replace usage of StatsdDataFactory with StatsFactory .
Wed, Jul 3, 9:44 AM · Observability-Metrics, Discovery-Search (Current work), CirrusSearch

Tue, Jul 2

pfischer added a comment to T367391: Setup a test project to validate upload to the Gitlab package registry.

@Gehel, regarding the maven coordinates: I'm not sure about the .test in the group ID, I have not that seen. Did you choose it on purpose to make sure this is obviously for (internal) testing only?

Tue, Jul 2, 4:16 PM · Patch-For-Review, User-brennen, Data-Platform-SRE (2024.07.08 - 2024.07.28), Release-Engineering-Team, Java-Scala-Standardization

Mon, Jul 1

pfischer updated subscribers of T286814: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string.

We skipped estimation of this ticket for now, since we have to investigate the issue first to better understand where the deviation from the schema originates. @EBernhardson might be able to help, since he authored some of that javascript.

Mon, Jul 1, 3:39 PM · MW-1.43-notes (1.43.0-wmf.14; 2024-07-16), Discovery-Search (Current work), Wikimedia-production-error, Data-Engineering

Tue, Jun 18

pfischer moved T367691: SUP: Retry 429 (rate limit) at HTTP client level from In Progress to Needs review on the Discovery-Search (Current work) board.
Tue, Jun 18, 4:10 PM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T367691: SUP: Retry 429 (rate limit) at HTTP client level.
Tue, Jun 18, 4:06 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T367691: SUP: Retry 429 (rate limit) at HTTP client level from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Tue, Jun 18, 4:06 PM · Discovery-Search (Current work), CirrusSearch

Mon, Jun 17

pfischer claimed T365158: Homogenise jackson version .
Mon, Jun 17, 3:24 PM · Discovery-Search (Current work), Wikidata
pfischer moved T365158: Homogenise jackson version from Incoming to In Progress on the Discovery-Search (Current work) board.
Mon, Jun 17, 3:22 PM · Discovery-Search (Current work), Wikidata
pfischer updated Other Assignee for T361935: Adapt the WDQS Streaming Updater to update multiple WDQS subgraphs, added: dcausse.
Mon, Jun 17, 3:21 PM · Discovery-Search (Current work), Wikidata
pfischer created T367691: SUP: Retry 429 (rate limit) at HTTP client level.
Mon, Jun 17, 8:22 AM · Discovery-Search (Current work), CirrusSearch

May 31 2024

pfischer created T366343: SUP: Loosen fields definition of update event schema.
May 31 2024, 9:05 AM · Discovery-Search, CirrusSearch
pfischer created T366340: SUP: Incorrect overall fetch timeout calculation.
May 31 2024, 8:35 AM · Discovery-Search (Current work), CirrusSearch

May 30 2024

pfischer added a comment to T366253: Create a generic stream to populate CirrusSearch weighted_tags.

From a SUP perspective this would replace all sources of weighted tags (config option: stream name):

  • article-topic-stream: mediawiki.page_outlink_topic_prediction_change.v1
  • draft-topic-stream: mediawiki.revision_score_drafttopic
  • recommendation-create-stream: mediawiki.revision-recommendation-create
May 30 2024, 8:37 PM · Discovery-Search, CirrusSearch
pfischer added a comment to T357353: Application Security Review Request : NetworkSession MediaWiki extension .

I think if we aren't sure or there's no easy way to do an IP address restriction, we can skip it as this is low risk.

Was there any other tasks or work still outstanding here?

May 30 2024, 12:13 PM · NetworkSession, Discovery-Search (Current work), secscrum, Security, Application Security Reviews

May 16 2024

pfischer created T365158: Homogenise jackson version .
May 16 2024, 2:29 PM · Discovery-Search (Current work), Wikidata

May 15 2024

pfischer created T365044: SUP: fail over unknown config properties.
May 15 2024, 4:33 PM · Discovery-Search, CirrusSearch

May 14 2024

pfischer updated the task description for T364837: Q125918173 missing from elastic@codfw.
May 14 2024, 8:50 PM · Discovery-Search (Current work), CirrusSearch
pfischer created P62388 SubgraphRuleMatcherUnitTest.
May 14 2024, 3:34 PM · CirrusSearch

May 13 2024

pfischer claimed T361935: Adapt the WDQS Streaming Updater to update multiple WDQS subgraphs.
May 13 2024, 9:38 AM · Discovery-Search (Current work), Wikidata
pfischer claimed T363475: SUP: Shift Writes from Cirrus to SUP.
May 13 2024, 9:29 AM · Discovery-Search (Current work), CirrusSearch
pfischer moved T363475: SUP: Shift Writes from Cirrus to SUP from Incoming to In Progress on the Discovery-Search (Current work) board.
May 13 2024, 9:29 AM · Discovery-Search (Current work), CirrusSearch

May 6 2024

pfischer added a parent task for T363795: SUP: Add metric to determine deduplication window length: T328330: Create SLI / SLO on Search update lag.
May 6 2024, 3:14 PM · CirrusSearch, Discovery-Search
pfischer added a subtask for T328330: Create SLI / SLO on Search update lag: T363795: SUP: Add metric to determine deduplication window length.
May 6 2024, 3:14 PM · Data-Platform-SRE, Discovery-Search (Current work)

May 2 2024

pfischer changed the status of T362310: Implement global ratelimiting in our service mesh from Stalled to In Progress.
May 2 2024, 12:47 PM · serviceops, Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Apr 30 2024

pfischer created T363795: SUP: Add metric to determine deduplication window length.
Apr 30 2024, 7:31 AM · CirrusSearch, Discovery-Search

Apr 26 2024

pfischer updated subscribers of T357353: Application Security Review Request : NetworkSession MediaWiki extension .

@EBernhardson, according to @JMeybohm there is no way to limit the IP ranges of pod/service/namespace to associated them closely with an application (SUP).

Apr 26 2024, 2:56 PM · NetworkSession, Discovery-Search (Current work), secscrum, Security, Application Security Reviews

Apr 25 2024

pfischer updated the task description for T363475: SUP: Shift Writes from Cirrus to SUP.
Apr 25 2024, 1:52 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T363475: SUP: Shift Writes from Cirrus to SUP.
Apr 25 2024, 1:46 PM · Discovery-Search (Current work), CirrusSearch

Apr 18 2024

pfischer changed the status of T362310: Implement global ratelimiting in our service mesh from Open to Stalled.

I brought up this discussion with @JMeybohm and as it turns out, rate-limiting is a long-wanted feature for the MW API anyways, see T248543. Service/Ops is willing to discuss implementing it the envoy-way: Envoy supports local and remote/distributed rate limits, as described here. The least invasive approach to test this would be the following:

Apr 18 2024, 4:03 PM · serviceops, Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Apr 16 2024

pfischer added a comment to T362563: Application Security Review Request : async-profiler (Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events ).

What is required for the test environment? Currently I would follow those steps:

Apr 16 2024, 4:52 PM · Data-Platform-SRE, Discovery-Search, secscrum, Security, Application Security Reviews

Apr 11 2024

pfischer renamed T362310: Implement global ratelimiting in our service mesh from SUP rate limits for fetch to SUP rate-limit fetch.
Apr 11 2024, 10:16 AM · serviceops, Patch-For-Review, Discovery-Search (Current work), CirrusSearch
pfischer created T362310: Implement global ratelimiting in our service mesh.
Apr 11 2024, 9:40 AM · serviceops, Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Apr 8 2024

pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Apr 8 2024, 3:14 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from Needs review to To Be Deployed on the Discovery-Search (Current work) board.
Apr 8 2024, 3:14 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T356933: Streaming Updater should still make forward progress when one index has problems from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.
Apr 8 2024, 3:14 PM · Discovery-Search (Current work)

Apr 4 2024

pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from In Progress to Needs review on the Discovery-Search (Current work) board.
Apr 4 2024, 11:49 PM · Discovery-Search (Current work), CirrusSearch
pfischer triaged T361900: SUP: Allow precise control over connection pool size AND operator capacity as Medium priority.
Apr 4 2024, 11:22 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Apr 4 2024, 11:22 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.
Apr 4 2024, 11:22 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T361900: SUP: Allow precise control over connection pool size AND operator capacity from needs triage to Current work on the Discovery-Search board.
Apr 4 2024, 11:21 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T361900: SUP: Allow precise control over connection pool size AND operator capacity.
Apr 4 2024, 11:20 PM · Discovery-Search (Current work), CirrusSearch

Apr 2 2024

pfischer added a comment to T349772: Create dashboards/alerts for new Cirrus Streaming Updater.

Here's a list of metrics and alerts based on them:

  • alert if the combined kafka message-in-rate (see grafana panel) is 0 for more than 5 minutes, for the following topics
    • eqiad.cirrussearch.update_pipeline.update.rc0
    • codfw.cirrussearch.update_pipeline.update.rc0
  • alert if the combined kafka message-in-rate (see grafana panel) is 0.1 for more than 5 minutes, for the following topics
    • eqiad.cirrussearch.update_pipeline.fetch_error.rc0
    • codfw.cirrussearch.update_pipeline.fetch_error.rc0
Apr 2 2024, 5:06 PM · Data-Platform-SRE (2024.07.08 - 2024.07.28)

Mar 15 2024

pfischer moved T358938: Search suggests the Special:RunJobs page on all wikis, even though it's unlisted and not appropriate to suggest from In Progress to Needs review on the Discovery-Search (Current work) board.
Mar 15 2024, 2:01 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), MediaWiki-Search, Patch-For-Review, Discovery-Search (Current work)
pfischer added a comment to T358938: Search suggests the Special:RunJobs page on all wikis, even though it's unlisted and not appropriate to suggest.

@Jdforrester-WMF, I looked at the code. The CirrusSearch SearchEngine does not handle Special:… searches itself, instead it delegates to the (core) implementation which in turn delegates to the default TitlePrefixSearch where searches inside NS_SPECIAL are processed in PrefixSearch::specialSearch( $search, $limit, $offset ). This performs an in-memory search against pages listed in SpecialPageFactory::CORE_LIST.

Mar 15 2024, 2:00 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), MediaWiki-Search, Patch-For-Review, Discovery-Search (Current work)
pfischer claimed T358938: Search suggests the Special:RunJobs page on all wikis, even though it's unlisted and not appropriate to suggest.
Mar 15 2024, 12:20 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), MediaWiki-Search, Patch-For-Review, Discovery-Search (Current work)
pfischer moved T358938: Search suggests the Special:RunJobs page on all wikis, even though it's unlisted and not appropriate to suggest from Incoming to In Progress on the Discovery-Search (Current work) board.
Mar 15 2024, 12:20 PM · MW-1.42-notes (1.42.0-wmf.25; 2024-04-02), MediaWiki-Search, Patch-For-Review, Discovery-Search (Current work)

Mar 13 2024

pfischer moved T358472: Search dag image_suggestions_weekly failed with: Empty dataframe provided from In Progress to Needs review on the Discovery-Search (Current work) board.
Mar 13 2024, 5:56 PM · Discovery-Search (Current work), Structured-Data-Backlog, Image-Suggestions

Mar 5 2024

pfischer claimed T358472: Search dag image_suggestions_weekly failed with: Empty dataframe provided.
Mar 5 2024, 9:56 AM · Discovery-Search (Current work), Structured-Data-Backlog, Image-Suggestions
pfischer moved T358472: Search dag image_suggestions_weekly failed with: Empty dataframe provided from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Mar 5 2024, 9:55 AM · Discovery-Search (Current work), Structured-Data-Backlog, Image-Suggestions

Feb 29 2024

pfischer moved T356933: Streaming Updater should still make forward progress when one index has problems from In Progress to Needs review on the Discovery-Search (Current work) board.
Feb 29 2024, 7:01 PM · Discovery-Search (Current work)

Feb 20 2024

pfischer claimed T356933: Streaming Updater should still make forward progress when one index has problems.
Feb 20 2024, 2:22 PM · Discovery-Search (Current work)
pfischer moved T356933: Streaming Updater should still make forward progress when one index has problems from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Feb 20 2024, 2:22 PM · Discovery-Search (Current work)

Jan 18 2024

pfischer moved T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 18 2024, 3:21 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch

Jan 17 2024

pfischer created T355236: SUP: Provide config option for cirrussearch to partially disable writing to elasticsearch.
Jan 17 2024, 3:33 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

As of today, all non-private wikis featuring the cirrussearch extension publish page_rerender events by default.

Jan 17 2024, 1:39 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer moved T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis from In Progress to Needs Reporting on the Discovery-Search (Current work) board.
Jan 17 2024, 1:37 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Jan 15 2024

pfischer claimed T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 15 2024, 4:40 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Jan 15 2024, 4:39 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T355066: SUP: Process (large) JSON responses non-blocking to save memory from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 15 2024, 4:34 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch
pfischer renamed T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from SUP: Adapt sanitizer to allow SUP to operate next to cirrus jobs to SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 15 2024, 4:01 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T354322: SUP: link related grafana dash boards from Needs review to Needs Reporting on the Discovery-Search (Current work) board.
Jan 15 2024, 3:58 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from Needs review to Needs Reporting on the Discovery-Search (Current work) board.
Jan 15 2024, 3:58 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T355066: SUP: Process (large) JSON responses non-blocking to save memory.
Jan 15 2024, 2:26 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Jan 10 2024

pfischer created T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 10 2024, 6:15 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353715: Enable kafka log compaction for page_rerender on jumbo.

For reference, here's a screenshot of more kafka metrics around enabling compaction:

Jan 10 2024, 4:06 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 10 2024, 7:40 AM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 10 2024, 7:32 AM · Discovery-Search (Current work), CirrusSearch

Jan 9 2024

pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Jan 9 2024, 8:38 AM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354322: SUP: link related grafana dash boards from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 9 2024, 8:38 AM · Discovery-Search (Current work), CirrusSearch
pfischer created T354595: SUP: Production .
Jan 9 2024, 8:30 AM · Data-Platform-SRE (2024.02.12 - 2024.03.03), Discovery-Search (Current work), CirrusSearch
pfischer merged T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id into T354064: SUP: Partition update_pipeline kafka topic.
Jan 9 2024, 8:21 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer merged task T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id into T354064: SUP: Partition update_pipeline kafka topic.
Jan 9 2024, 8:21 AM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id.

Partitions + keyed records are already enabled on kafka-test, see T354064.

Jan 9 2024, 8:20 AM · Discovery-Search (Current work), CirrusSearch

Jan 8 2024

pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 10:17 PM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 9:59 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353460: The consumer job of the SUP does not achieve its expected throughput.

consumer-devnull (no resource request/limit overrides) correctly gets ioThreadCount=1, see logs:

Jan 8 2024, 9:59 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T350826: Test backfilling for cirrus-streaming-updater.

One of the key findings of the backfill tests was a lower-than-expected throughput, see T353460. That is mainly caused by a bug inside the flink consumer but is still a unexpectedly high rate of timeouts (from enovys perspective) see T354289.

Jan 8 2024, 4:52 PM · Discovery-Search (Current work), Data-Platform-SRE
pfischer updated the task description for T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 3:22 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T354517: Search Update Pipeline: HTTP client/proxy config.

Yes, you are right, Janis just told me. Alternatively, we can send a header x-envoy-max-retries: 0, see docs.

Jan 8 2024, 3:19 PM · Discovery-Search (Current work), CirrusSearch
pfischer renamed T354517: Search Update Pipeline: HTTP client/proxy config from Search Update Pipeline: Increase http request timeout to reduce retries to Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 2:52 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 9:29 AM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353460: The consumer job of the SUP does not achieve its expected throughput.

@JMeybohm, thanks! That brought down the throttling.

Jan 8 2024, 8:06 AM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 7:54 AM · Discovery-Search (Current work), CirrusSearch

Jan 4 2024

pfischer moved T354322: SUP: link related grafana dash boards from Incoming to In Progress on the Discovery-Search (Current work) board.
Jan 4 2024, 9:25 AM · Discovery-Search (Current work), CirrusSearch
pfischer set the point value for T354322: SUP: link related grafana dash boards to 2.
Jan 4 2024, 9:24 AM · Discovery-Search (Current work), CirrusSearch
pfischer created T354322: SUP: link related grafana dash boards.
Jan 4 2024, 9:24 AM · Discovery-Search (Current work), CirrusSearch

Jan 3 2024

pfischer moved T353430: The elasticsearch client does not properly estimate the size of the bulk requests from In Progress to Blocked/Waiting on the Discovery-Search (Current work) board.
Jan 3 2024, 10:31 PM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T354064: SUP: Partition update_pipeline kafka topic.
Jan 3 2024, 10:25 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops