Page MenuHomePhabricator

pfischer (Peter Fischer)
User

Projects

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Sep 2 2022, 7:28 AM (77 w, 1 d)
Availability
Available
IRC Nick
pfischer
LDAP User
Peter Fischer
MediaWiki User
PFischer-WMF [ Global Accounts ]

Recent Activity

Tue, Feb 20

pfischer claimed T356933: Streaming Updater should still make forward progress when one index has problems.
Tue, Feb 20, 2:22 PM · Discovery-Search (Current work)
pfischer moved T356933: Streaming Updater should still make forward progress when one index has problems from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Tue, Feb 20, 2:22 PM · Discovery-Search (Current work)

Jan 18 2024

pfischer moved T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 18 2024, 3:21 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch

Jan 17 2024

pfischer created T355236: SUP: Provide config option for cirrussearch to partially disable writing to elasticsearch.
Jan 17 2024, 3:33 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

As of today, all non-private wikis featuring the cirrussearch extension publish page_rerender events by default.

Jan 17 2024, 1:39 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer moved T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis from In Progress to Needs Reporting on the Discovery-Search (Current work) board.
Jan 17 2024, 1:37 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Jan 15 2024

pfischer claimed T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 15 2024, 4:40 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Jan 15 2024, 4:39 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T355066: SUP: Process (large) JSON responses non-blocking to save memory from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 15 2024, 4:34 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch
pfischer renamed T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs from SUP: Adapt sanitizer to allow SUP to operate next to cirrus jobs to SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 15 2024, 4:01 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer moved T354322: SUP: link related grafana dash boards from Needs review to Needs Reporting on the Discovery-Search (Current work) board.
Jan 15 2024, 3:58 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from Needs review to Needs Reporting on the Discovery-Search (Current work) board.
Jan 15 2024, 3:58 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T355066: SUP: Process (large) JSON responses non-blocking to save memory.
Jan 15 2024, 2:26 PM · Patch-For-Review, Discovery-Search (Current work), CirrusSearch

Jan 10 2024

pfischer created T354793: SUP: Adapt saneitizer to allow SUP to operate next to cirrus jobs.
Jan 10 2024, 6:15 PM · MW-1.42-notes (1.42.0-wmf.17; 2024-02-06), Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353715: Enable kafka log compaction for page_rerender on jumbo.

For reference, here's a screenshot of more kafka metrics around enabling compaction:

Jan 10 2024, 4:06 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 10 2024, 7:40 AM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 10 2024, 7:32 AM · Discovery-Search (Current work), CirrusSearch

Jan 9 2024

pfischer moved T354517: Search Update Pipeline: HTTP client/proxy config from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Jan 9 2024, 8:38 AM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354322: SUP: link related grafana dash boards from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 9 2024, 8:38 AM · Discovery-Search (Current work), CirrusSearch
pfischer created T354595: SUP: Production .
Jan 9 2024, 8:30 AM · Data-Platform-SRE ( 2024.02.12 - 2024.03.03), Discovery-Search (Current work), CirrusSearch
pfischer merged T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id into T354064: SUP: Partition update_pipeline kafka topic.
Jan 9 2024, 8:21 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer merged task T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id into T354064: SUP: Partition update_pipeline kafka topic.
Jan 9 2024, 8:21 AM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353473: The cirrussearch.update_pipeline.update stream should be keyed by wiki and page_id.

Partitions + keyed records are already enabled on kafka-test, see T354064.

Jan 9 2024, 8:20 AM · Discovery-Search (Current work), CirrusSearch

Jan 8 2024

pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 10:17 PM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 9:59 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353460: The consumer job of the SUP does not achieve its expected throughput.

consumer-devnull (no resource request/limit overrides) correctly gets ioThreadCount=1, see logs:

Jan 8 2024, 9:59 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T350826: Test backfilling for cirrus-streaming-updater.

One of the key findings of the backfill tests was a lower-than-expected throughput, see T353460. That is mainly caused by a bug inside the flink consumer but is still a unexpectedly high rate of timeouts (from enovys perspective) see T354289.

Jan 8 2024, 4:52 PM · Discovery-Search (Current work), Data-Platform-SRE
pfischer updated the task description for T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 3:22 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T354517: Search Update Pipeline: HTTP client/proxy config.

Yes, you are right, Janis just told me. Alternatively, we can send a header x-envoy-max-retries: 0, see docs.

Jan 8 2024, 3:19 PM · Discovery-Search (Current work), CirrusSearch
pfischer renamed T354517: Search Update Pipeline: HTTP client/proxy config from Search Update Pipeline: Increase http request timeout to reduce retries to Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 2:52 PM · Discovery-Search (Current work), CirrusSearch
pfischer created T354517: Search Update Pipeline: HTTP client/proxy config.
Jan 8 2024, 9:29 AM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353460: The consumer job of the SUP does not achieve its expected throughput.

@JMeybohm, thanks! That brought down the throttling.

Jan 8 2024, 8:06 AM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T353460: The consumer job of the SUP does not achieve its expected throughput.
Jan 8 2024, 7:54 AM · Discovery-Search (Current work), CirrusSearch

Jan 4 2024

pfischer moved T354322: SUP: link related grafana dash boards from Incoming to In Progress on the Discovery-Search (Current work) board.
Jan 4 2024, 9:25 AM · Discovery-Search (Current work), CirrusSearch
pfischer set the point value for T354322: SUP: link related grafana dash boards to 2.
Jan 4 2024, 9:24 AM · Discovery-Search (Current work), CirrusSearch
pfischer created T354322: SUP: link related grafana dash boards.
Jan 4 2024, 9:24 AM · Discovery-Search (Current work), CirrusSearch

Jan 3 2024

pfischer moved T353430: The elasticsearch client does not properly estimate the size of the bulk requests from In Progress to Blocked/Waiting on the Discovery-Search (Current work) board.
Jan 3 2024, 10:31 PM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T354064: SUP: Partition update_pipeline kafka topic.
Jan 3 2024, 10:25 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer moved T354064: SUP: Partition update_pipeline kafka topic from In Progress to Needs Reporting on the Discovery-Search (Current work) board.
Jan 3 2024, 10:25 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer moved T354064: SUP: Partition update_pipeline kafka topic from Incoming to In Progress on the Discovery-Search (Current work) board.
Jan 3 2024, 10:24 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer updated the task description for T354064: SUP: Partition update_pipeline kafka topic.
Jan 3 2024, 10:24 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer moved T354197: SUP: deployment: allow passing integers from In Progress to Needs review on the Discovery-Search (Current work) board.
Jan 3 2024, 10:21 PM · Discovery-Search (Current work), CirrusSearch
pfischer claimed T354197: SUP: deployment: allow passing integers.
Jan 3 2024, 10:21 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354197: SUP: deployment: allow passing integers from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.
Jan 3 2024, 10:20 PM · Discovery-Search (Current work), CirrusSearch

Jan 2 2024

pfischer moved T354197: SUP: deployment: allow passing integers from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.
Jan 2 2024, 4:54 PM · Discovery-Search (Current work), CirrusSearch
pfischer triaged T354197: SUP: deployment: allow passing integers as High priority.
Jan 2 2024, 4:54 PM · Discovery-Search (Current work), CirrusSearch
pfischer moved T354197: SUP: deployment: allow passing integers from needs triage to Current work on the Discovery-Search board.
Jan 2 2024, 4:53 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353715: Enable kafka log compaction for page_rerender on jumbo.

@Ottomata, we considered this but but decided against it since

Jan 2 2024, 4:52 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer created T354197: SUP: deployment: allow passing integers.
Jan 2 2024, 4:03 PM · Discovery-Search (Current work), CirrusSearch
pfischer added a comment to T353715: Enable kafka log compaction for page_rerender on jumbo.

@Ottomata, yes, this was intended to a) save disk space and b) reduce the number of records that have to be processed in case of a back fill. Events representing "page X has been re-rendered" seemed a perfect use case where only the latest event is meaningful and worth to be kept.

Jan 2 2024, 3:39 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer updated the task description for T353715: Enable kafka log compaction for page_rerender on jumbo.
Jan 2 2024, 10:58 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer placed T354064: SUP: Partition update_pipeline kafka topic up for grabs.
Jan 2 2024, 10:50 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer updated the task description for T353715: Enable kafka log compaction for page_rerender on jumbo.
Jan 2 2024, 10:46 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer changed the status of T353715: Enable kafka log compaction for page_rerender on jumbo from In Progress to Open.
Jan 2 2024, 10:36 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer added projects to T353715: Enable kafka log compaction for page_rerender on jumbo: SRE, serviceops.
Jan 2 2024, 10:18 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer changed the status of T353715: Enable kafka log compaction for page_rerender on jumbo from Open to In Progress.
Jan 2 2024, 9:50 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer moved T353715: Enable kafka log compaction for page_rerender on jumbo from needs triage to elastic / cirrus on the Discovery-Search board.
Jan 2 2024, 9:49 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer changed the status of T354064: SUP: Partition update_pipeline kafka topic from Open to In Progress.
Jan 2 2024, 9:49 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer moved T354064: SUP: Partition update_pipeline kafka topic from needs triage to Current work on the Discovery-Search board.
Jan 2 2024, 9:48 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer renamed T354064: SUP: Partition update_pipeline kafka topic from SUP: Partition update topic to SUP: Partition update_pipeline kafka topic.
Jan 2 2024, 9:47 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer updated the task description for T354064: SUP: Partition update_pipeline kafka topic.
Jan 2 2024, 9:42 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer set the point value for T354064: SUP: Partition update_pipeline kafka topic to 3.
Jan 2 2024, 8:40 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer claimed T354064: SUP: Partition update_pipeline kafka topic.
Jan 2 2024, 8:15 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops

Dec 27 2023

pfischer updated the task description for T354064: SUP: Partition update_pipeline kafka topic.
Dec 27 2023, 10:10 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops
pfischer created T354064: SUP: Partition update_pipeline kafka topic.
Dec 27 2023, 10:07 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), SRE, serviceops

Dec 19 2023

pfischer updated the task description for T353430: The elasticsearch client does not properly estimate the size of the bulk requests.
Dec 19 2023, 10:44 PM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T353715: Enable kafka log compaction for page_rerender on jumbo.
Dec 19 2023, 2:50 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer created T353715: Enable kafka log compaction for page_rerender on jumbo.
Dec 19 2023, 2:47 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), serviceops, SRE, CirrusSearch, Discovery-Search
pfischer updated the task description for T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.
Dec 19 2023, 2:40 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

@elukey, we have an updated estimate of the expected topic size increment per wiki we publish page_rerender records for: https://docs.google.com/spreadsheets/d/1Fp44MdLxUVlxi03MBD_64m0zQErny-9jUD5C6RGf_bU/edit#gid=670687915

Dec 19 2023, 2:35 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Dec 18 2023

pfischer added a comment to T353430: The elasticsearch client does not properly estimate the size of the bulk requests.

Upstream elasticsearch bug

Dec 18 2023, 4:36 PM · Discovery-Search (Current work), CirrusSearch
pfischer updated the task description for T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.
Dec 18 2023, 4:15 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer created P54487 SUP compare-cluster.py stats.
Dec 18 2023, 2:35 PM · Discovery-Search

Dec 13 2023

pfischer added a comment to P54377 JAR hell prevents elasticsearch from starting.
relforge1003-relforge-eqiad analysis-hebrew          7.10.2
relforge1003-relforge-eqiad analysis-icu             7.10.2
relforge1003-relforge-eqiad analysis-nori            7.10.2
relforge1003-relforge-eqiad analysis-smartcn         7.10.2
relforge1003-relforge-eqiad analysis-stconvert       7.10.2
relforge1003-relforge-eqiad analysis-stempel         7.10.2
relforge1003-relforge-eqiad analysis-ukrainian       7.10.2
relforge1003-relforge-eqiad experimental-highlighter 7.10.2
relforge1003-relforge-eqiad extra                    7.10.2-wmf10
relforge1003-relforge-eqiad extra-analysis-esperanto 7.10.2
relforge1003-relforge-eqiad extra-analysis-homoglyph 7.10.2-wmf8
relforge1003-relforge-eqiad extra-analysis-khmer     7.10.2-wmf8
relforge1003-relforge-eqiad extra-analysis-serbian   7.10.2
relforge1003-relforge-eqiad extra-analysis-slovak    7.10.2-wmf8
relforge1003-relforge-eqiad extra-analysis-turkish   7.10.2-wmf8
relforge1003-relforge-eqiad extra-analysis-ukrainian 7.10.2-wmf8
relforge1003-relforge-eqiad ltr                      1.5.4-wmf1-es7.10.2
relforge1003-relforge-eqiad repository-s3            7.10.2
relforge1004-relforge-eqiad analysis-hebrew          7.10.2
relforge1004-relforge-eqiad analysis-icu             7.10.2
relforge1004-relforge-eqiad analysis-nori            7.10.2
relforge1004-relforge-eqiad analysis-smartcn         7.10.2
relforge1004-relforge-eqiad analysis-stconvert       7.10.2
relforge1004-relforge-eqiad analysis-stempel         7.10.2
relforge1004-relforge-eqiad analysis-ukrainian       7.10.2
relforge1004-relforge-eqiad experimental-highlighter 7.10.2
relforge1004-relforge-eqiad extra                    7.10.2-wmf10
relforge1004-relforge-eqiad extra-analysis-esperanto 7.10.2
relforge1004-relforge-eqiad extra-analysis-homoglyph 7.10.2-wmf8
relforge1004-relforge-eqiad extra-analysis-khmer     7.10.2-wmf8
relforge1004-relforge-eqiad extra-analysis-serbian   7.10.2
relforge1004-relforge-eqiad extra-analysis-slovak    7.10.2-wmf8
relforge1004-relforge-eqiad extra-analysis-turkish   7.10.2-wmf8
relforge1004-relforge-eqiad extra-analysis-ukrainian 7.10.2-wmf8
relforge1004-relforge-eqiad ltr                      1.5.4-wmf1-es7.10.2
relforge1004-relforge-eqiad repository-s3            7.10.2
Dec 13 2023, 3:24 PM · Discovery-Search
pfischer created P54377 JAR hell prevents elasticsearch from starting.
Dec 13 2023, 1:25 PM · Discovery-Search

Dec 12 2023

pfischer updated the task description for T353270: Update elasticsearch instance extra plugin.
Dec 12 2023, 5:43 PM · Data-Platform-SRE (2023.12.01 - 2023.12.31)
pfischer created T353270: Update elasticsearch instance extra plugin.
Dec 12 2023, 3:10 PM · Data-Platform-SRE (2023.12.01 - 2023.12.31)

Dec 11 2023

pfischer moved T344595: [JVM Languages Stewardship] Aggregate documentation on JVM languages best practices from In Progress to Needs Reporting on the Discovery-Search (Current work) board.
Dec 11 2023, 4:06 PM · Java-Scala-Standardization, Discovery-Search (Current work)

Dec 5 2023

pfischer updated the task description for T352767: Add pfischer to wmf-deployment.
Dec 5 2023, 2:15 PM · Gerrit-Privilege-Requests
pfischer created T352767: Add pfischer to wmf-deployment.
Dec 5 2023, 1:54 PM · Gerrit-Privilege-Requests

Dec 4 2023

pfischer updated the task description for T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.
Dec 4 2023, 1:47 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

Not right now, but if needed we'll surely be able to create something.

Dec 4 2023, 1:43 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer claimed T350974: search/glent fails on Java 11.
Dec 4 2023, 12:30 PM · Discovery-Search (Current work), ci-test-error
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

We currently don't have any git-ops-like way to apply specific settings to topics

Dec 4 2023, 11:05 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

@elukey, for page re-render, we're definitely interested only in the latest event, since we only care for the fact that a page was re-rendered, not how many times (especially for the backfill scenario). Further, that would reduce the storage requirements. Is that of any concern?

Dec 4 2023, 10:32 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

@brouberol, if you have time, could you configure codfw.mediawiki.cirrussearch.page_rerender.v1 and eqiad.mediawiki.cirrussearch.page_rerender.v1 with cleanup.policy=delete,compact, please? If you have any best practices regarding the compaction configuration, I'd be happy to learn about those, too. The retention period would remain 7 days for now.

Dec 4 2023, 8:32 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Dec 1 2023

pfischer updated the task description for T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.
Dec 1 2023, 1:25 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Nov 30 2023

pfischer added a comment to T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

@elukey, sure. We would start onboarding smaller wikis first (test, it, fr) before moving on to the bigger ones.

Nov 30 2023, 12:04 PM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Nov 28 2023

pfischer updated subscribers of T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.

@elukey, we would like to start populating this kafka topic on kafka-main. Enabling page_rerender is the last missing source we need, to ensure our search stream processing works with production volumes. The calculations can be found in the following spreadsheet, sheet "Kafka", line 12.

Nov 28 2023, 10:54 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer claimed T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis.
Nov 28 2023, 9:57 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops
pfischer moved T351503: Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis from Ready for Dev -- SRE/Ops to In Progress on the Discovery-Search (Current work) board.
Nov 28 2023, 9:57 AM · Data-Platform-SRE (2024.01.01 - 2024.01.21), Discovery-Search (Current work), serviceops

Nov 17 2023

pfischer committed rDPOM392f19234dd1: [maven-release-plugin] prepare for next development iteration (authored by pfischer).
[maven-release-plugin] prepare for next development iteration
Nov 17 2023, 3:39 PM
pfischer committed rDPOM5f13e04d131d: [maven-release-plugin] prepare release discovery-parent-pom-1.70 (authored by pfischer).
[maven-release-plugin] prepare release discovery-parent-pom-1.70
Nov 17 2023, 3:39 PM
pfischer committed rDPOMb3e69d6b40bd: bump plugin and dependency versions (authored by pfischer).
bump plugin and dependency versions
Nov 17 2023, 3:38 PM
pfischer committed rDPOM91b27830020c: [maven-release-plugin] prepare for next development iteration (authored by pfischer).
[maven-release-plugin] prepare for next development iteration
Nov 17 2023, 3:31 PM
pfischer committed rDPOM4e4cc1bc8cdb: [maven-release-plugin] prepare release discovery-parent-pom-1.69 (authored by pfischer).
[maven-release-plugin] prepare release discovery-parent-pom-1.69
Nov 17 2023, 3:31 PM
pfischer created P53544 Plugin Updates.
Nov 17 2023, 1:32 PM · Discovery-Search
pfischer updated the task description for T351089: Utilize Kafka Headers.
Nov 17 2023, 12:29 PM · Data-Engineering
pfischer updated the task description for T351089: Utilize Kafka Headers.
Nov 17 2023, 12:29 PM · Data-Engineering
pfischer updated the task description for T351089: Utilize Kafka Headers.
Nov 17 2023, 12:28 PM · Data-Engineering